CivArchive
    ← All articles
    Published June 1, 2024by Boris_Morphine

    Deforum On Schedule - a free-to-use GPT that helps you write motion schedules based on camera angles

    171 views0 reactions1 comments on CivitAI1 collected
    tool guide

    All the credit for the backbone of this project goes to _Wizz_!

    The goal of this project was to take the excellent Deforum scripting GPT prompt written by _Wizz_ and incorporate detailed .txt files into the GPT's knowledge base so it's easier to use natural language to communicate the motion schedule of your Deforum script.

    The camera angles this GPT can (for the most part) translate includes the following:

    -Dolly Zoom
    -Tilt
    -Crane Shot
    -Close Up
    -Handheld Shot
    -Extreme Long Shot
    -Whip Pan
    -Slow Pan
    -Tracking shot
    -Drone shot
    -Slow Motion (experimental, work in progress)
    -Timelapse (experimental, usually breaks the flow of the animation)
    -Perspective Flip 2D (theta, phi, gamma, TV)

    It takes some getting used to and I would recommend asking the GPT what it knows about the shot you want to use before you try to incorporate it. have the bot give you it's interpretation of the camera motion, ask for a short (150 frame) sample script, and run it through deforum to see if it needs any tweaks. I'm trying to make the calibration process easier but this GPT is less prone to laziness overall since it's packed with instructions on how to build motion pictures.

    This is all pretty basic so don't feel disappointed when it can't shoot Goodfellas. But if you're into making transforming music videos, this is the tool for you!

    The GPT is is programmed to run _Wizz_'s original script first and then you can start playing around with the camera angles. Type "Activate" as your first prompt to get things going.

    Also, I think it only works if you have a subscription to GPT-4. But feel free to correct me if I'm wrong!

    Here's the GPT: https://chatgpt.com/g/g-mavbWflA8-deforum-on-schedule

    And here are two samples I made, the first video was a SD 1.5 project and the second video was an SDXL project: