평범한 필기장

Paper : https://arxiv.org/abs/2401.11739 EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion ModelsDiffusion models have recently received increasing research attention for their remarkable transfer abilities in semantic segmentation tasks. However, generating fine-grained segmentation masks with diffusion models often requires additional training on anarxiv.org0. Abstract Diffusion m..

Paper : https://arxiv.org/abs/2303.04761 Video-P2P: Video Editing with Cross-attention ControlThis paper presents Video-P2P, a novel framework for real-world video editing with cross-attention control. While attention control has proven effective for image editing with pre-trained image generation models, there are currently no large-scale video gearxiv.orgGithub : https://github.com/dvlab-resea..

0. AbstractKey Challenge : Naive DDIM inversion process의 각 step에서의 randomness와 inaccuracy에 의해 발생하는 error를 제한하는 것.이는 video editing에서 temporal inconsistency를 야기할 수 있다.1. Introduction 본 논문은 diffusion model을 이용해서 zero-shot video editing method를 만드는 것을 목표로 한다. Inversion process는 temporally cohorent initial latents의 sequence를 제공함으로써 video editing 결과에 도움을 준다. 그러나 아래의 이미지처럼 direct inversion process는 pot..

Paper : https://arxiv.org/abs/2403.12002 DreamMotion: Space-Time Self-Similar Score Distillation for Zero-Shot Video EditingText-driven diffusion-based video editing presents a unique challenge not encountered in image editing literature: establishing real-world motion. Unlike existing video editing approaches, here we focus on score distillation sampling to circumvent the stanarxiv.orgProject P..

Paper : https://arxiv.org/abs/2408.06070 ControlNeXt: Powerful and Efficient Control for Image and Video GenerationDiffusion models have demonstrated remarkable and robust abilities in both image and video generation. To achieve greater control over generated results, researchers introduce additional architectures, such as ControlNet, Adapters and ReferenceNet, to intearxiv.orgGithub : https://g..

Paper : https://arxiv.org/abs/2403.07420 DragAnything: Motion Control for Anything using Entity RepresentationWe introduce DragAnything, which utilizes a entity representation to achieve motion control for any object in controllable video generation. Comparison to existing motion control methods, DragAnything offers several advantages. Firstly, trajectory-based isarxiv.orgProject Page : https://..

Paper : https://arxiv.org/abs/2311.17338 MagDiff: Multi-Alignment Diffusion for High-Fidelity Video Generation and EditingThe diffusion model is widely leveraged for either video generation or video editing. As each field has its task-specific problems, it is difficult to merely develop a single diffusion for completing both tasks simultaneously. Video diffusion sorely relyinarxiv.org1. Introduc..

Paper : https://arxiv.org/abs/2403.14617v3 Videoshop: Localized Semantic Video Editing with Noise-Extrapolated Diffusion InversionWe introduce Videoshop, a training-free video editing algorithm for localized semantic edits. Videoshop allows users to use any editing software, including Photoshop and generative inpainting, to modify the first frame; it automatically propagates those charxiv.org0. ..

Project Page : https://style-aligned-gen.github.io/ StyleAlignStyle Aligned Image Generation via Shared Attention CVPR 2024, Oral Amir Hertz* 1 Andrey Voynov* 1 Shlomi Fruchter† 1 Daniel Cohen-Or† 1,2 1 Google Research 2 Tel Aviv University *Indicates Equal Contribution †Indicates Equal Advising [Paper]    style-aligned-gen.github.ioPaper : https://arxiv.org/abs/2312.02133 Style Aligned Image Ge..

Paper, Project Page, Github GitHub - inbarhub/DDPM_inversion: Official pytorch implementation of the paper: "An Edit Friendly DDPM Noise Space: Inversion anOfficial pytorch implementation of the paper: "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". CVPR 2024. - GitHub - inbarhub/DDPM_inversion: Official pytorch implementa...github.com해결하려는 문제 본 논문에서는 기존 DDIM latent가 아닌 DDPM la..