Are you always worried about buying the wrong size or style when buying clothes online? Now, this black technology will completely change your online shopping experience! The Google Research team has launched Fashion-VDM, a virtual fitting technology based on video diffusion model, allowing you to experience the fun of trying on without leaving home. It not only generates realistic trial-on videos, but also simulates dynamic changes in clothes, such as wrinkles and swings, with a much better effect than previous static picture fitting software.
Do you often hesitate about your favorite clothes when buying them online, worrying that it is not appropriate to buy them home? Don't worry, there is a black technology that can save you now! The latest Fashion-VDM technology developed by the Google Research team will give you enough You can experience the pleasure of trying on all kinds of beautiful clothes without leaving home!
What is the magical magic of Fashion-VDM? Simply put, it is a video diffusion model. As long as you provide a photo of a piece of clothing and a video of yourself, it can generate a video of you wearing the clothing, and the effect is Super realistic!
You may ask, aren't there any virtual fitting software on the market? Most of them are based on images and can only generate static pictures. The effect is often terrible. When you wear clothes on you like stickers, there is no sense of reality. Word. Fashion-VDM is completely different. It generates dynamic videos, which not only show the effect of clothes wearing at different angles, but also simulates the dynamic changes of clothes, such as wrinkles, swings, etc., which is exactly the same as a real person trying on!
The secret of Fashion-VDM is that it uses split-CFG, a technology that can control the information of characters and clothing more accurately, ensuring that the generated video retains your own characteristics and is perfect. The details of the clothes are displayed.
In order to make the video smoother and more natural, Fashion-VDM also adopts a progressive time training strategy, first using a large amount of image data to train the model, and then gradually increase the training time of the video data, and finally generate an ultra-long video with a length of up to 64 frames. , say goodbye to the stuttering and flashing of the screen!
What's even more amazing is that Fashion-VDM also combines image and video data for joint training, which means that it can not only learn the details of the clothing from the pictures, but also learn the movements of the characters and the dynamic changes of the clothing from the video, and ultimately generate More realistic and convincing fitting videos.
To test the effect of Fashion-VDM, the researchers compared it with other virtual fittings and animation techniques on the market, and the results showed that Fashion-VDM achieved overwhelming victory in image quality, video fluency and clothing restoration!
Of course, Fashion-VDM has some limitations at present, such as when dealing with obscured clothing areas, the details may not be accurate enough, and the figure may also undergo slight deformation. However, I believe that with the continuous development of technology, Fashion-VDM will become more and more perfect, and ultimately completely subvert our online shopping experience!
In the future, you no longer have to worry about buying the wrong clothes when shopping online. With Fashion-VDM, the fitting room and other things are so weak!
Project address: https://johannakarras.github.io/Fashion-VDM/
The emergence of Fashion-VDM marks a new height for virtual fitting technology. Although there are still some shortcomings, its powerful functions and realistic effects are already amazing. I believe that in the near future, it will completely change our online shopping habits and allow us to enjoy the fun of shopping easily!