Paper Dreams: Real Time Collaboration with Machine Learning for Artistic Expression
How can human creativity be supported by artificial intelligence?
Think about the last time you collaborated with someone in a brainstorming session. What was that interaction like? Your brainstorming partner may suggest an idea, and then you associate that idea with something new. Next thing you know, the two of you are bouncing ideas off of each other, drawing sketches on a whiteboard, and then going online trying to find more inspiration based off of various Google searches. Without collaboration, your ideas would have only been an echo chamber of your original thoughts.
With Paper Dreams, we built the experience of collaborative creation using machine learning.
Built with Pytorch, Flask, and Javascript, Paper Dreams is a web application that promotes a highly dynamic, interactive back-and-forth between a human artist and the Paper Dreams system, incorporating customized machine learning models and representations to assist the user’s visual expression. The Paper Dreams system processes the sketch the user generates, “recognizes” what has been drawn, and creates personalized suggestions for new elements and colors. Papers Dreams aims to inspire and empower individuals who believe they are not “the creative type”, are experiencing an artistic block, or are looking to express themselves in new ways.
Paper Dreams augments the drawing experience in three different ways: by adding textures/colors, suggesting other elements/drawings for the scene, and introducing serendipity.
Adaptive Colorization
to be continued…