MAKE ART with Artificial Intelligence

MAKE ART with Artificial Intelligence

How to use AI, NFT and Blockchain super-tools to make and sell your art. A richly illustrated tutorial on drawing sketching, inking, light, shading, coloring, face generation, animation and anything art with AI (check the book).

Book by Kevin Ashley: FREE eBook on LivebookAI or Amazon: (https://www.amazon.com/dp/B091J3T4HM)

Amazon Bestseller in Neural Networks, Arts

Resources and Learning Materials

• Book, Paperback edition, quality color print, feels and reads like an art book, 184 pages, 200 illustrations, 20+ study guides, highlighted tutorial sections, more illustrations than e-book (recommended with this course)
• Ebook (Amazon) - reflowable text, easy navigation to tutorials and easy read on phone, tablet or desktop
• Video Tutorials - Video tutorials, get new updates and video deep dives monthly.

• The Art of AI Collection - all art from my book in one place. If you would like to own some of the artworks I made for this book.

Note: Most examples are available in playground environments like Google Colab and Binder. For standalone notebooks, it is recommended that your kernel environment is set to Python 3. Check requirements.txt for dependencies.

Chapter 1. Getting Started

Project 1.1 Drawing Sketches

In this project we begin by simply sketching a portrait, a pose of a human or an animal, and scene, a building or a landscape. Just draw anything you like, we’ll use it later in the book. With this method by combining creativity and AI, we’ll make beautiful illustrations, like these:

(see the book)

Chapter 2. Creative Tools

NEW! Video Tutorial: Creative Tools

Project 2.1 Creative Tools and AI

In this project we begin by simply sketching a portrait, a pose of a human or an animal, and scene, a building or a landscape. Just draw anything you like, we’ll use it later in the book.

• Quick Draw - Doodling with AI and predictive sketching. This is a great tool to understand how AI can predict what you are thinking to sketch! It also comes with Quick Draw dataset, collected from thousands of drawings! ( Demo )
• Photoshop Neural Filters, and Adobe Sensei - is the classic digital tool’s window to AI creativity. Explore neural filters that Adobe engineers collected as part of Photoshop. ( Article )
• Clip Studio Paint AI Colorizing – another classic illustration and drawing tool very popular with manga and anime artists. This tool includes AI colorizing that allows you to apply color to your sketches. We discuss AI based coloring in depth in this book. ( Article )
• Petalica Paint ( Demo )
• OpenAI Microscope – in this book we discuss neural networks. OpenAI came out with a great tool to visualize neural networks. This is a fantastic tool to understand how images get processed through different types of neural nets. (Demo)
• Activation Atlases (Article, )

Project 2.2 Getting Started with Notebooks

• Getting Started with Notebooks - Style Transfer ( ) - this is a basic introduction to using an online Colab notebook. No installation required, but a GPU kernel recommended. Very easy code with just a few steps.

Chapter 3. Neural Networks

(see the book)

Project 3.1 Create a Single Neuron

• Make a Single Neuron ()

Project 3.2 Neural Networks

• Make a Simple Neural Network ()
• Activation Functions ()
• Visualizing Neurons ()
• Activation Atlas (Article , )

Project 3.3 Neural Methods

• Classification ()
• Detection ()
• Segmentation ()

Chapter 4. Drawing and Sketching

(see the book)

Project 4.1 Explore Sketching

• Quick Draw - Doodling with AI and predictive sketching. This is a great tool to understand how AI can predict what you are thinking to sketch! It also comes with Quick Draw dataset, collected from thousands of drawings! ( Demo )
• Sketch RNN ( Demo )
• Predicting the rest of the sketch you can see a variety of different endings predicted by the model. ( Demo )
• Morphing one sketch to another the model will come up with new drawings that it believes to be the interpolation between the two original drawings ( Demo )
• Mimic your sketches Rather than drawing a perfect duplicate copy of your drawing, the model will try to mimic your drawing instead. ( Demo )
• Cartoonify – turn your photo in a drawing, Google experiment ( Demo )
• Monster Mash - sketch based tool for 3D modeling and animation. This tool allows you to animate your sketch by inflating a 2D drawing to 3D and animating (Demo, Article )

Project 4.2 Colorize your Sketch

• Colorize Sketches - great online model to get started with ()

NEW! Video Tutorial: Colorize Your Sketch with A.I.

• Style2Paints - one of the best tools for colorization, for best results this tool requires installation (Docs ,Code)
• Colorize Photos ()
• Colorize GrayScale ()
• Colorize Sketch to Grayscale ()

Project 4.3 More on Sketching

NEW! Video Tutorial: Light and Shadow with A.I.

• Sketch from portraits (ArtLine) ( Code , )
• Cartoons from Portraits ( Code , )
• Pix2Pix ( , Code , Demo )
• ShadeSketch ( VIDEO, Paper , Demo , Code )
• Sketch Simplification ( Paper , Code )
• Sketching Lines Refining ( Code )
• Sketch based Deep Learning ( Read more… )
• Design and technical sketches Sketch Graph
• Super-Resolution enhance lower resolution images with AI ()

Chapter 5. Faces and Expressions

(see the book)

Project 5.1 Face and Facial Features

• Facial Detection facial detection with Google MediaPipe ( Docs , )
• Facial Features facial features with Google MediaPipe ( Docs , )
• Hair Recoloring - Super realistic real time hair recoloring and segmentation. ( Docs )
• Iris and Depth - an amazing work that shows how to reconstruct depth from an iris. ( Docs )
• Danbooru Anime Dataset - tagged anime dataset ( Demo )

Project 5.2 Generate Anime Faces

• Generate Anime Faces - this notebook shows how to use StyleGAN to generate anime faces. ( )
• Photorealistic faces with NVIDIA StyleGAN2 ( Article , Code )
• Generate Cartoon Faces with Customization - this notebook uses StyleGAN2 to create customizable cartoon faces based on Cartoon Set ( )
• Training StyleGAN model on portraits train StyleGAN to generate portraits long, advanced ( Docs , )
• This Anime Does not Exist is a great exploration tool for anime generation ( This Anime Does Not Exist )

Chapter 6. Body and Poses

Project 6.1 Poses and Actions

• Detecting Body Keypoints using PyTorch ( )
• Body Pose Estimation using MediaPipe and a 1790 painting The Reverend Robert Walker Skating on Duddingston Loch, better known by its shorter title The Skating Minister, an oil painting attributed to Henry Raeburn ( )
• Pose in 3D with DensePose( )
• Reconstructing 3D with human iris - an amazing work that shows how to reconstruct depth from an iris. ( Docs )
• Fashion and Clothing classifying fashion and clothing ( )
• High Resolution 3D Human Digitization ( , Paper)

Project 6.2 Pose Tools for 3D in Art

1. Get assets for this example from The Art of AI Collection Practical Pose Kit.These assets include a ClipStudio Paint and a Photoshop file.
2. Open ClipStudio Paint file with the illustration and select 3D Painter layer (marked with a cube)
3. Play with changing painter’s avatar position and orientation. Note that the avatar pose includes constraints on joint movements that somewhat correspond to anatomical joints, but you still have the flexibility.
4. Once you’re happy with the avatar pose, you reduce level opacity to 15-20%, start a new layer, choose your favorite ink pen or a pencil and trace the avatar.

Chapter 7. Animation

NEW! Video Tutorial: 3D Animation

Project 7.1 Animating Characters

• Animate a pose/face illustration Download pose illustration assets from The Art of AI Collection - look for Pose Animation Asset Kit. Use Pose Animator to animate the SVG.
• Pose Animator check this fantastic work to animate your illustrations. ( Demo - Camera , Demo - Image , Code )

Project 7.2 Animation Examples

• Animating Faces - Lips with LipGAN ( )
• Animating Faces - Lips with Wave2Lip ( Demo , Code , )
• First Order Motion Model for Image Animation (Paper)
• An Illusion of Life (Book)
• Animator’s Survival Kit (Book)
• Pose Animator (Faces and Poses)( Article , Code , Demo)
• Animating Loss Landscapes ( Article , Code )

3D Animation Video Tutorial

• Monster Mash - sketch based tool for 3D modeling and animation. This tool allows you to animate your sketch by inflating a 2D drawing to 3D and animating (Demo, Article )
• Generating Abstract Patterns - tools to generate abstract texture patterns we used in this video (Demo, Article )

Chapter 8. Landscapes and Scenery

Project 8.1 Examples

• Image Generation and Interpolation check how to generate images with BigGAN, including interpolations - note the interpolation from a cruise liner ship to a monastery! ( )
• Landscape Painting with Generative Adversarial Networks (Article)
• GauGAN - AI as a smart brush - NVIDIA project (Demo)

Chapter 9. Style and Creativity

Project 9.1 Style, Compositions and Patterns

• Patterns ( , Article )
• Transparency and Patterns ()
• Exaggerating Features (Cartoonification) ( )
• Activation Atlas (
• Style Transfer(Original Colab , Colab)
• Text to Illustration (Deep Daze) - OpenAI CLIP and SIREN ( )
• Text to Illustration (Big Sleep) - OpenAI CLIP and BigGAN ( )
• Style Transfer ( )
• Style Transfer with Blending Proportions ( )
• Style Transfer Parametrizations ( )
• Generating Images with BigGAN ( )
• WikiArt Model Artwork Trained ( )

• Artwork Trained Model ( )

• Style Transfer
  • Fast Style Transfer (Code)
  • Generative Style Transfer (Tensorflow)
• Generating Images from Text
  • Generating Images from Text (DALL-E)
• Generating Anime Faces
  • Anime Faces Generation (Article)
• Fashion
  • Fashion Tool , Code
• 3D Models
  • Article

Using Adobe Creative Suite with Codex

Check this section

For artists using Photoshop, Illustrator and other Adobe Creative Suite products, OpenAI models and Codex in particular, provide a wealth of stuff we can use to make art with AI, simplify working with graphics tools and even automating some of this work. Here’s some examples of Photoshop and Illustrator scripts that were generated by OpenAI Codex model. I have a detailed walkthough in my video course.

• Astrology with Illustrator and Codex - Illustrator and Codex
• Remove Background Layer in Photoshop with AI - Photoshop and Codex
• Add and Center Text in Photoshop with AI - Photoshop and Codex
• Adobe XD Plugin - Adobe XD Plugin

The Art of AI

All illustrations from this book are available in The Art of AI Collection on block chain. If you collect digital art, this collection contains original digital illustrations, sketches and more.

Resources

• FREE eBook on LivebookAI - with subscription. Livebook is a new awesome ebook and AI content service.
• Book (Paperback), quality color print, feels and reads like an art book, 184 pages, 200 illustrations, 20+ study guides, highlighted tutorial sections, more illustrations than e-book (recommended with this course)
• Ebook (Amazon) - reflowable text, easy navigation to tutorials and easy read on phone, tablet or desktop
• Video Tutorials
• The Art of AI - all art and sketches from my book in one place. If you would like to own some of the artworks I made for this book.
• For eductors - Here’s a guide for educators - How To Teach Art and Technology Class Based on This Book