Color and Texture Dual Pipeline Lightweight Style Transfer
ShiQi Jiang
Style transfer methods typically generate a single stylized output of color
and texture coupling for reference styles, and color transfer schemes may
introduce distortion or artifacts when processing reference images with
duplicate textures. To solve the problem, we propose a Color and Texture Dual
Pipeline Lightweight Style Transfer CTDP method, which employs a dual pipeline
method to simultaneously output the results of color and texture transfer.
Furthermore, we designed a masked total variation loss to suppress artifacts
and small texture representations in color transfer results without affecting
the semantic part of the content. More importantly, we are able to add texture
structures with controllable intensity to color transfer results for the first
time. Finally, we conducted feature visualization analysis on the texture
generation mechanism of the framework and found that smoothing the input image
can almost completely eliminate this texture structure. In comparative
experiments, the color and texture transfer results generated by CTDP both
achieve state-of-the-art performance. Additionally, the weight of the color
transfer branch model size is as low as 20k, which is 100-1500 times smaller
than that of other state-of-the-art models.