China's first AIGC director co-creation program will be officially launched on December 6. The project was jointly initiated by Kuaishou's self-developed video generation large-scale model product "Keling AI" and nine well-known directors including Li Shaohong, Jia Zhangke, Ye Ji

China’s first AIGC director co-creation plan will be officially launched on December 6. The plan is developed by Kuaishou's self-developed video-generated large-scale model product "Keling AI", in collaboration with nine well-known directors including Li Shaohong, Jia Zhangke, Ye Jintian, Xue Xiaolu, Yu Baimei, Dong Runnian, Zhang Chiyu, Wang Zichuan, and Wang Maomao. co-sponsored. On December 3, Kuaishou released the trailer of the "Keling AI Director Co-Creation Project" and announced the titles of 9 AIGC short films, covering diverse genres such as fantasy, fantasy, family love, and animation.

Keling AI director cooperation plan finalized poster

These 9 experimental short films all use Keling AI for video generation. The film director relies entirely on video to generate large models, and the group is deeply involved in the creation of film-level content, which is very popular in China. This is the first time. The launch of the "Keling AI Director Co-Creation Plan" is not only an active exploration of the boundaries of film and television creation and production by new technologies, but also makes the roadmap for AIGC technology to deeply participate in film and television content production clearer.

With the development of video generation large model technology, it has become a consensus that new technologies and new tools are expected to promote industrial integration, reconstruct production processes, and promote innovation in the content creative industry. Since its release on June 6,

Keling AI has served more than 5 million users as of November 20, generating 51 million videos and 150 million pictures. China's first AIGC original fantasy short drama "Mountains and Seas Strange Mirror: Chopping Waves" is provided with in-depth technical support by Keling AI. Within 15 days after its launch on July 13, the five episodes of the feature film were viewed more than 52 million times, and the topic exposure on the entire network exceeded 4.3 100 million. On September 9, Kuaishou teamed up with nine well-known directors to launch the "Keling AI Director Co-Creation Project", challenging all of them to use Keling AI to generate movie-level video content. Every exploration in the film and television industry is broadening the imagination that video generation technology brings to film and television creation.

"The annual meeting cannot be stopped!" After joining the "Keling AI Co-Creation Project", Dong Runnian, the screenwriter and director of "", chose to create a fantasy story that takes place in the "new world". This is a type that he has almost never tried in his previous creative career. "When I describe a world to AI in various languages, the way AI presents the world based on my description is completely different from my imagination. It has its own unique logic. This encourages me to try what I imagined. But there is no story that has been expressed yet. I tend to think that this is a kind of cooperation with AI, rather than simply using a tool." Dong Runnian said.

Zhang Chiyu, the director of " Alone on the Moon ", was inspired by the work "Defending Nanshan Park" by the famous science fiction author Tian Rui Shuofu, and created the science fiction short film "The Last Line of Defense" with Chongqing as the story background. During the screen generation process, the shot of the protagonist setting a table and eating hot pot on top of a giant robot was impressive.

Zhang Chiyu said that in the traditional film production process, although such a shot can be realized, it will either require expensive scenery or post-production with the help of a green screen. Relying on Keling AI's technology, a more efficient workflow can be used to quickly implement the ideas in the mind into concrete images. As the first large-scale video generation model open to the global public for testing,

continues to carry out technology iterations and product upgrades, and continues to maintain its lead among global large-scale video generation models. Since its release on June 6, Keling AI has carried out more than ten function upgrades, launched version 1.5 basic model, and launched an independent app.

For the first time in his creative career, director Jia Zhangke tried to use a robot as the protagonist of a film. The biggest technical challenge he faced was the consistency of the characters. It is difficult to maintain the facial features of people, which is a key problem in the field of large model generation from video. During the production of the "Keling AI Director Co-Creation Plan", Keling AI launched the video face training model function. Using only a very small amount of video material, an exclusive face model can be trained, which solves the problem of being unable to create stable characters in AI video generation in the past. Based on such new features, the director team finally chose to use a bionic robot with a "human face" as the protagonist and successfully completed this 6-minute silicon-based road film.

In addition, Director Jia Zhangke also applied the newly launched "lip-syncing" function of Keling AI, and challenged the "lip-syncing" function's ability to speak in dialects. This function allows users to upload audio after generating a character video, and combine the audio content with Video character lip synchronization meets the basic needs of character dialogue in film and television creation. Jia Zhangke, who mocks himself for not being able to write scripts in Mandarin, successfully made a robot speak Shanxi Fenyang dialect in his first AIGC short film "Wheat Harvest".

The film and television entertainment field is one of the fields where AIGC applications have been implemented the fastest. Technological innovations, including Keling AI, are greatly lowering the threshold for video content production and improving the efficiency of content production. Industry insiders predict that with the continuous breakthroughs in visual generation large model technology, in the next one to two years, industrial-level production tools for film and television are expected to be implemented in the AIGC field and applied on a large scale.

Visual large models and products represented by Keling AI will gradually become the new infrastructure and new tools of the visual industry. The "Keling AI Director Co-Creation Plan" aims to promote the in-depth integration of humanities and art with AIGC technology through the exploration of AIGC-produced film-level content, and make co-creation between people and AI a new creative form and trend.

"The core of film creation has always been human emotions and thoughts." AIGC application engineer Wen Weiss, who participated in the Keling AI director co-creation plan, believes that "AI has provided us with unprecedented creative tools, allowing us to create in unprecedented ways. To tell stories, to express emotions.”

Director Li Shaohong has experienced a technological leap from the film era to the digital era in her career. She calls the "Keling AI Director Co-Creation Plan" an experiment. Through this experiment, she hopes to find the relationship between human beings as creators and The answer to how breakthrough AI technologies can coexist. "I think AI is currently more of a tool, and it will be very helpful in our creation," Li Shaohong said. Zhang Di, vice president of

Kuaishou Technology and head of the large model team, said frankly that as a new technology and new application, users are currently more tolerant of the new species Keling AI. In the future, Kuaishou will insist on technological investment and innovation in the direction of large models, insist on exploring real value in real scenes, and meet the real needs of users.

"In the 'Keling AI Director Plan', we saw the creative stimulation of people and AI in the co-creation process, and also saw the application bottlenecks. We hope that Keling AI can truly become a mature creation in the next year Tools can become creative tools for more ordinary users, and can be truly applied on a large scale in film and television-level scenes." Zhang Di also revealed that Kelingai will also upgrade its cooperation model to provide more personalized enterprise-level customized services for the film and television industry to better serve the industrial intelligent upgrade of the film and television industry.