MAKE ART with Artificial Intelligence

MAKE ART with Artificial Intelligence

How to use AI, NFT and Blockchain super-tools to make and sell your art. A richly illustrated tutorial on drawing sketching, inking, light, shading, coloring, face generation, animation and anything art with AI (check the book).

Book by Kevin Ashley (https://www.amazon.com/dp/B091J3T4HM)

http://kevinashley.com

Amazon Bestseller in Neural Networks, Arts

Resources and Learning Materials

  • Book, Paperback edition, quality color print, feels and reads like an art book, 184 pages, 200 illustrations, 20+ study guides, highlighted tutorial sections, more illustrations than e-book (recommended with this course)
  • Ebook (Amazon) - reflowable text, easy navigation to tutorials and easy read on phone, tablet or desktop
  • Video Tutorials - Video tutorials, get new updates and video deep dives monthly.

https://awesomeai.vhx.tv/

  • The Art of AI Collection - all art from my book in one place. If you would like to own some of the artworks I made for this book.

Note: Most examples are available in playground environments like Google Colab and Binder. For standalone notebooks, it is recommended that your kernel environment is set to Python 3. Check requirements.txt for dependencies.

Chapter 1. Getting Started

Project 1.1 Drawing Sketches

In this project we begin by simply sketching a portrait, a pose of a human or an animal, and scene, a building or a landscape. Just draw anything you like, we’ll use it later in the book. With this method by combining creativity and AI, we’ll make beautiful illustrations, like these:

http://kevinashley.com

(see the book)

Chapter 2. Creative Tools

NEW! Video Tutorial: Creative Tools

https://awesomeai.vhx.tv/

Project 2.1 Creative Tools and AI

In this project we begin by simply sketching a portrait, a pose of a human or an animal, and scene, a building or a landscape. Just draw anything you like, we’ll use it later in the book.

  • Quick Draw - Doodling with AI and predictive sketching. This is a great tool to understand how AI can predict what you are thinking to sketch! It also comes with Quick Draw dataset, collected from thousands of drawings! ( Demo )
  • Photoshop Neural Filters, and Adobe Sensei - is the classic digital tool’s window to AI creativity. Explore neural filters that Adobe engineers collected as part of Photoshop. ( Article )
  • Clip Studio Paint AI Colorizing – another classic illustration and drawing tool very popular with manga and anime artists. This tool includes AI colorizing that allows you to apply color to your sketches. We discuss AI based coloring in depth in this book. ( Article )
  • Petalica Paint ( Demo )
  • OpenAI Microscope – in this book we discuss neural networks. OpenAI came out with a great tool to visualize neural networks. This is a fantastic tool to understand how images get processed through different types of neural nets. (Demo)
  • Activation Atlases (Article, Open In Colab)

Project 2.2 Getting Started with Notebooks

  • Getting Started with Notebooks - Style Transfer ( Open In Colab ) - this is a basic introduction to using an online Colab notebook. No installation required, but a GPU kernel recommended. Very easy code with just a few steps.

Chapter 3. Neural Networks

(see the book) http://kevinashley.com

Project 3.1 Create a Single Neuron

  • Make a Single Neuron (Open In Colab)

Project 3.2 Neural Networks

  • Make a Simple Neural Network (Open In Colab)
  • Activation Functions (Open In Colab)
  • Visualizing Neurons (Open In Colab)
  • Activation Atlas (Article , Open In Colab)

Project 3.3 Neural Methods

  • Classification (Open In Colab)
  • Detection (Open In Colab)
  • Segmentation (Open In Colab)

Chapter 4. Drawing and Sketching

(see the book) http://kevinashley.com

Project 4.1 Explore Sketching

  • Quick Draw - Doodling with AI and predictive sketching. This is a great tool to understand how AI can predict what you are thinking to sketch! It also comes with Quick Draw dataset, collected from thousands of drawings! ( Demo )
  • Sketch RNN ( Demo )
  • Predicting the rest of the sketch you can see a variety of different endings predicted by the model. ( Demo )
  • Morphing one sketch to another the model will come up with new drawings that it believes to be the interpolation between the two original drawings ( Demo )
  • Mimic your sketches Rather than drawing a perfect duplicate copy of your drawing, the model will try to mimic your drawing instead. ( Demo )
  • Cartoonify – turn your photo in a drawing, Google experiment ( Demo )
  • Monster Mash - sketch based tool for 3D modeling and animation. This tool allows you to animate your sketch by inflating a 2D drawing to 3D and animating (Demo, Article )

Project 4.2 Colorize your Sketch

  • Colorize Sketches - great online model to get started with (Open In Colab)

NEW! Video Tutorial: Colorize Your Sketch with A.I.

http://https://awesomeai.vhx.tv/

  • Style2Paints - one of the best tools for colorization, for best results this tool requires installation (Docs ,Code)
  • Colorize Photos (Open In Colab)
  • Colorize GrayScale (Open In Colab)
  • Colorize Sketch to Grayscale (Open In Colab)

Project 4.3 More on Sketching

NEW! Video Tutorial: Light and Shadow with A.I.

http://https://awesomeai.vhx.tv/

  • Sketch from portraits (ArtLine) ( Code , Open In Colab)
  • Cartoons from Portraits ( Code , Open In Colab )
  • Pix2Pix ( Open In Colab , Code , Demo )
  • ShadeSketch ( VIDEO, Paper , Demo , Code )
  • Sketch Simplification ( Paper , Code )
  • Sketching Lines Refining ( Code )
  • Sketch based Deep Learning ( Read more… )
  • Design and technical sketches Sketch Graph
  • Super-Resolution enhance lower resolution images with AI (Open In Colab)

Chapter 5. Faces and Expressions

http://kevinashley.com

(see the book)

Project 5.1 Face and Facial Features

  • Facial Detection facial detection with Google MediaPipe ( Docs , Open In Colab)
  • Facial Features facial features with Google MediaPipe ( Docs , Open In Colab)
  • Hair Recoloring - Super realistic real time hair recoloring and segmentation. ( Docs )
  • Iris and Depth - an amazing work that shows how to reconstruct depth from an iris. ( Docs )
  • Danbooru Anime Dataset - tagged anime dataset ( Demo )

Project 5.2 Generate Anime Faces

  • Generate Anime Faces - this notebook shows how to use StyleGAN to generate anime faces. ( Open In Colab )
  • Photorealistic faces with NVIDIA StyleGAN2 ( Article , Code )
  • Generate Cartoon Faces with Customization - this notebook uses StyleGAN2 to create customizable cartoon faces based on Cartoon Set ( Open In Colab )
  • Training StyleGAN model on portraits train StyleGAN to generate portraits long, advanced ( Docs , Open In Colab)
  • This Anime Does not Exist is a great exploration tool for anime generation ( This Anime Does Not Exist )

Chapter 6. Body and Poses

Project 6.1 Poses and Actions

  • Detecting Body Keypoints using PyTorch ( Open In Colab)
  • Body Pose Estimation using MediaPipe and a 1790 painting The Reverend Robert Walker Skating on Duddingston Loch, better known by its shorter title The Skating Minister, an oil painting attributed to Henry Raeburn ( Open In Colab)
  • Pose in 3D with DensePose( Open In Colab)
  • Reconstructing 3D with human iris - an amazing work that shows how to reconstruct depth from an iris. ( Docs )
  • Fashion and Clothing classifying fashion and clothing ( Open In Colab )
  • High Resolution 3D Human Digitization ( Open In Colab , Paper)

Project 6.2 Pose Tools for 3D in Art

  1. Get assets for this example from The Art of AI Collection Practical Pose Kit.These assets include a ClipStudio Paint and a Photoshop file.
  2. Open ClipStudio Paint file with the illustration and select 3D Painter layer (marked with a cube)
  3. Play with changing painter’s avatar position and orientation. Note that the avatar pose includes constraints on joint movements that somewhat correspond to anatomical joints, but you still have the flexibility.
  4. Once you’re happy with the avatar pose, you reduce level opacity to 15-20%, start a new layer, choose your favorite ink pen or a pencil and trace the avatar.

Chapter 7. Animation

NEW! Video Tutorial: 3D Animation

https://awesomeai.vhx.tv/

Project 7.1 Animating Characters

Project 7.2 Animation Examples

  • Animating Faces - Lips with LipGAN ( Open In Colab)
  • Animating Faces - Lips with Wave2Lip ( Demo , Code , Open In Colab)
  • First Order Motion Model for Image Animation (Paper)
  • An Illusion of Life (Book)
  • Animator’s Survival Kit (Book)
  • Pose Animator (Faces and Poses)( Article , Code , Demo)
  • Animating Loss Landscapes ( Article , Code )

3D Animation Video Tutorial

  • Monster Mash - sketch based tool for 3D modeling and animation. This tool allows you to animate your sketch by inflating a 2D drawing to 3D and animating (Demo, Article )
  • Generating Abstract Patterns - tools to generate abstract texture patterns we used in this video (Demo, Article )

Chapter 8. Landscapes and Scenery

Project 8.1 Examples

  • Image Generation and Interpolation check how to generate images with BigGAN, including interpolations - note the interpolation from a cruise liner ship to a monastery! ( Open In Colab)
  • Landscape Painting with Generative Adversarial Networks (Article)
  • GauGAN - AI as a smart brush - NVIDIA project (Demo)

Chapter 9. Style and Creativity

Project 9.1 Style, Compositions and Patterns

  • Patterns ( Open In Colab , Article )
  • Transparency and Patterns (Open In Colab)
  • Exaggerating Features (Cartoonification) ( Open In Colab )
  • Activation Atlas (Open In Colab
  • Style Transfer(Original Colab , Colab)
  • Text to Illustration (Deep Daze) - OpenAI CLIP and SIREN ( Open In Colab )
  • Text to Illustration (Big Sleep) - OpenAI CLIP and BigGAN ( Open In Colab )
  • Style Transfer ( Open In Colab )
  • Style Transfer with Blending Proportions ( Open In Colab )
  • Style Transfer Parametrizations ( Open In Colab )
  • Generating Images with BigGAN ( Open In Colab )
  • WikiArt Model Artwork Trained ( Open In Colab )
  • Artwork Trained Model ( Open In Colab )

  • Style Transfer
  • Generating Images from Text
    • Generating Images from Text (DALL-E)
  • Generating Anime Faces
  • Fashion
  • 3D Models

The Art of AI

All illustrations from this book are available in The Art of AI Collection on block chain. If you collect digital art, this collection contains original digital illustrations, sketches and more.

The Art of AI Collection

Resources