" legend " uses AI face-changing technology to restore the 27-year-old Jackie Chan , who starred in 80% of the movie.
1. Al Pacino and Robert De Niro’s faces are also a bit stiff after ai’s age reduction.
2. Director Guo Fan once said that AI technology will be used in the screenwriting process of "The Wandering Earth 3".
3. Director Lu Chuan used AI technology to complete part of the post-production of the "Western Wild" documentary.
Recently, the new film "Legend" starring Jackie Chan suffered a setback in terms of reputation and box office. It scored 5.4 on Douban and earned more than 70 million in box office after more than 10 days of release. Bona Pictures, which had a net loss of 108 million to 153 million in the first half of the year, was surprised. Not within reach. Bona Pictures established its own AI studio this year. Before the release of "Legend", AI technology had always been the gimmick of the film, but after it was released, it became something that audiences didn't buy. Bona Pictures used the current popular AI face-changing technology to restore the 27-year-old Jackie Chan, who starred in 80% of the film. However, the overall presentation had many inconsistencies. Audiences said that Jackie Chan in the film was very out of character. The effect of AI in simulating the expressions of real people is not good enough, which creates an uncanny valley effect for the audience.
This time, "AI face-changing technology" is used to restore younger versions of actors. As early as 2019, Ang Lee's " Gemini Man " and Martin Scorsese's " The Irishman " have both tried it , some viewers at that time said that the characters' faces were a bit stiff after the "age reduction".
Even in Hollywood, where technology is more mature, AI face-changing technology is not perfect, and a series of AI-related technologies have also caused a lot of controversy in Hollywood. Last year’s strike wave among screenwriters and actors in Hollywood. In addition to the salary conflicts between actors, screenwriters and management, the threat that AI may replace actors and screenwriters also prompted them to strike.
Compared with Hollywood, the response from Chinese film and television creators seems to be relatively mild and positive. Liancheng Yijian, a self-media person who observes film and television in the industry, believes: "It is understood that AI has fully entered all fields of film production, from the creation of early script outlines to the drawing of mid-stage shooting storyboards, as well as in the later stages, whether it is editing, dubbing, or adjusting. There are cases involving AI technology in almost the entire process of color, special effects, subtitles, posters, etc. It can be said that AI has become one of the indispensable basic technologies or tools for film production..."
Regardless of whether AI technology still exists There is a lot of immaturity, but it is already a reality that the film industry has to face.
AI technology is an auxiliary technology that protects creative energy well
On February 16, 2024, openai released the video generation model sora, which can generate one-minute high-definition long videos by inputting text. As soon as sora was released, it caused panic in the entire film and television industry, believing that it would have a huge impact on the field of visual creation. Against such a general background, many film professionals in the industry have begun to apply AI technology.
On April 11 this year, Guo Fan, the director of the " Wandering Earth " series, said at a conference on "AI, movies, AI movies and discussions about the future" that "The Wandering Earth 3" will use AI technology, " For the early writing work, language models such as claude3 are very helpful to our film and television creation. Claude3 is more "human" than gpt4, and it will even "test" the questions I asked. "
Guo Fan. Added: "When the screenwriters are meeting, the recording and AI recognition can analyze the speeches of each participant, and finally form a corpus. After 10 consecutive days of 10 hours of discussion every day, AI recognition can accurately refine each person's speech in 'seconds'" The important point is to avoid the complexity of manual query. The same is true for writing scripts. With the help of the claude3 language model, we basically free up our hands... As a movie, the script needs to be converted into audio-visual language, unlike novels. With such emphasis on literature, language models such as claude3 and gpt4 can fully undertake the task of "explaining things clearly."
In Guo Fan's view, this is not a form of laziness, but "a good protection of creation." energy".After basically coming up with some plots, Guo Fan's team will use runway, stable diffusion, and midjourney to generate visual concept maps, and there will also be dynamic concept videos. They will then select one or two final use options. At this time, artificial intelligence began to intervene, and detailed design, split models, and animation testing were carried out based on the intentional concepts generated by AI. AI technology greatly saves time and energy.
On June 21, during the 26th Shanghai International Film Festival, Lenovo Group and the famous film director Lu Chuan filmed the documentary "Western Fields" for its premiere. Earlier, director Lu Chuan and Lenovo Group announced the joint establishment of Lenovo Yuanchuang AI Imaging Laboratory. The documentary "Xiye" is the first work of the joint laboratory. Lenovo provided Nishino with an AI animal behavior detection system. Lu Chuan completed part of the post-production of the "Western Wild" documentary with the help of Lenovo's AI PC, which greatly improved the speed of creative visualization and allowed his vision for the film to become reality with the help of AI. This is an important case of using AI technology to shoot documentaries in China.
Whether it is "The Wandering Earth 3" or "Western Wilderness", AI technology has given them convenience in shooting, saving time and energy investment. Some people in the industry were worried about AI technology replacing humans in coming up with ideas, but this was overstated for the time being.
Yan Peng, a member of the Science Writers Association and a film critic, told Nandu reporter: "AI technology can only be an auxiliary technology, it is not a creative (technology). This technology depends on the user's aesthetic level and technology Level. In the future, AI will be widely used in the pre-, mid- and post-production of movies, but it will be used as a tool, not a magical technology that turns stone into gold. In the future, it will be used well. There is a huge difference between creators and creators who use it poorly, so a good creator will not be controlled by AI, he will be able to control AI technology calmly. "
The cultivation of film talents with AI technology will keep up. Yet?
As a new technology, AI technology has a large talent gap, and the corresponding education in major universities is still lagging behind. One of the reasons is that AI technology is changing rapidly, and college teachers are also in the learning stage.
At present, the film and television university in China that systematically develops AI courses is the Shanghai Vancouver Film School of Shanghai University. Starting from February 2023, the school will offer AI courses. This is the first AI film course in a Shanghai film school. Nandu reporter contacted Odet Abadia, the head of the Wen Ying AI Future Imaging Research Center of the school. In her course teaching, she used AI as an auxiliary tool to improve the efficiency of industry workflow. The teachers and students of the school use the large language model (LLMS) to set up script creation courses. With the help of this language model, students can better analyze the script and then improve the scene description or dialogue characterization, and stimulate their minds about potential scenes. storm.
The school has different levels of courses in the curriculum. The most basic one is to use mainstream artificial intelligence applications, such as midjourney, runway or elevenlabs. These applications are very easy to use, so that students will not be afraid of difficulties and can learn more later. Deepen little by little.
odet believes that AI is a great boon to the traditional film production process, especially in terms of reducing costs and increasing speed. In the past, even just a few years ago, only a handful of filmmakers who already had project development funds could afford to hire concept artists to help them translate their film ideas into images. For artists, creating even one frame is time-consuming and expensive. Nowadays, for any young filmmaker, creating your own concept drawings is just a matter of paying a small subscription fee, and the process becomes very fast. We can even change our thoughts and opinions countless times and try different things without considering the cost and time of each modification.
Of course, in order to prevent students from relying too much on artificial intelligence and becoming lazy. Odet advocates that AI should be gradually introduced into the curriculum. Students need to learn how to use traditional methods to complete something before they are taught how to use AI to improve efficiency and save costs.
At present, AI technology is mainly discussed at the "technical" level in China, but in fact many people have raised questions about the ethical issues of AI, and odet has also captured this public opinion. She believes that whether it is from the training method of the model, bias, possibility of abuse, or copyright issues, etc., odet's response is to plan to launch a new course called "Artificial Intelligence Literacy." In this course, she will cover all of these topics so that students can properly understand the full background and context of use of AI, not just a user of AI.
AI teaching must move from the “technical” level to the “Tao” level.
Animation production is more sensitive to the AI technology environment than live-action movies.
In addition to live-action movies, AI technology is also used in animation production.
Zhu Haipeng, director of the Animation Department of the Bay Area Film and Television Industry College of Guangdong University of Finance and Economics, told Nandu reporters: "Compared with live-action films, animated films are actually more sensitive to changes in such a technical environment. In the past two years, films such as mid journey and stable Tools such as diffusion and chatgpt have actually begun to be used by animation companies of all sizes in China. Some animation companies have gradually developed their own AI applications.
New technologies represented by AI have an impact on the animation industry. Mainly reflected in two aspects: The first aspect is the transformation of the entire production process. Traditional animation production, whether it is two-dimensional or three-dimensional, has a very clear and strict workflow. But now with the emergence of AI tools, we find that. It will have a new production trend.
Work that may have required a team in the past may now be completed by a few people with the help of AI technology. This is undoubtedly another subversion of the traditional animation production process. It is AI technology that may subvert the current structure of the animation production industry, because the main large models are currently controlled by some high-tech companies, such as domestic Baidu, Alibaba, and some large comprehensive technology companies like Douyin and Kuaishou. , these technology companies are likely to layout the development of the animation industry in the future with their own large models and the big data they have mastered. This will have some important impacts on the traditional animation industry structure. "
" Similarly, the emergence of AI technology. There is also a need to innovate talent development programs for animation production. Zhu Haipeng believes that the emergence of AI technology has also brought some challenges to the cultivation of animation professionals. The first point is that the construction of the curriculum system needs to adapt to this situation, and some basic computer application knowledge should be added to the entire curriculum system, and then Course content of some AI tools;
The second point is the challenge for teachers. The existing teachers are mainly from traditional animation majors, so the teachers’ mastery of this new technology is also at an exploratory stage. It can be said that teachers Being on the same starting line as students, relatively speaking, this provides a great demand and requirement for teachers;
The third point is the change in the integration of industry and education. In traditional animation production, schools and enterprises actually There is still a big difference or gap, and it is difficult for college students to have access to actual projects. However, with the emergence of AI, universities and enterprises are on the same starting line. At this time, if universities can give full play to some of their advantages in scientific research and use the opportunities provided by AI to further strengthen cooperation with enterprises, so as to integrate industry and education. to make more breakthrough achievements.
Summary
AI is rapidly iterated and updated, and there will be new developments every time, which is a challenge for creators and teachers. From the earliest fear to the subsequent embrace of learning, the change in mentality also shows that everyone realizes that the technological wave is unstoppable.
"Legend", as the first attempt at AI with large domestic capital, received a lot of negative reviews. Tang Jili, the director of "Legend" responded by saying that the AI technology is not perfect and is still being studied. I hope everyone will be more tolerant. Although "27-year-old AI Jackie Chan" was not successful, its role as a link between the past and the future cannot be ignored.Creators in the industry should regard it as a case study, otherwise it will be a waste of expensive trial and error.
Written by: Nandu reporter Liu Yifan Intern Lin Ruiyuan Special translator: Lin Hao
