Skip to content

Release 0.2.0 - #1

Merged
brennanmceachran merged 2 commits into
mainfrom
feature/animated-reference
Oct 10, 2025
Merged

Release 0.2.0#1
brennanmceachran merged 2 commits into
mainfrom
feature/animated-reference

Conversation

@brennanmceachran

Copy link
Copy Markdown
Owner

Summary

  • release 0.2.0: animated reference support and TUI polish

Testing

  • pnpm typecheck
  • pnpm build

@gemini-code-assist

Copy link
Copy Markdown

Summary of Changes

Hello @brennanmceachran, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request significantly enhances the sora-cli tool by integrating animated reference support, allowing users to achieve better continuity in their video generations. It also includes several user interface refinements to the Terminal User Interface (TUI), making the prompt composition and job management experience more intuitive and efficient. The changes aim to provide a more powerful and user-friendly workflow for interacting with the Sora 2 video API.

Highlights

  • Animated Reference Support: Introduced animated reference capabilities to both the TUI and CLI. Users can now auto-build WebP/APNG references from completed jobs or upload their own files via the --input-reference option, leveraging bundled ffmpeg and ffprobe binaries for a zero-configuration experience.
  • TUI Polish and Usability Improvements: The prompt composer's reference picker has been polished for a more consistent layout, clearer highlights, and inline status summaries. Keyboard navigation cues in the auto-reference job list have been improved, and overall TUI navigation has been refined.
  • Version Update: The project version has been bumped to 0.2.0 to reflect these new features and improvements.
  • New Dependencies: Added @ffmpeg-installer/ffmpeg and @ffprobe-installer/ffprobe as dependencies to enable the new video processing features directly within the application.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces significant new functionality by adding animated reference support, which is a great enhancement. The implementation is robust, including bundled ffmpeg/ffprobe binaries for a zero-config experience and fallback mechanisms. The TUI has also been polished to accommodate these new features. My review includes suggestions to improve code maintainability by reducing duplication, enhancing type safety, and fixing a minor keyboard navigation regression in the UI.

Comment thread README.md Outdated

- In the TUI, move to the new **Reference** row to toggle between `None`, `Upload file`, and `Auto from job`. Auto builds an animated WebP/APNG from the tail frames of the selected completed job so the next render starts exactly where the last one ended.
- For manual continuity, supply `--input-reference ./reference.webp` (or `.png`) when running the CLI. The file is uploaded with your render request and also copied into the job’s output folder for reuse.
- `sora-cli` bundles ffmpeg and ffprobe, so the auto-builder works out of the box on macOS and Linux without additional setup. Set `SORA_CLI_FFMPEG_PATH` / `SORA_CLI_FFPROBE_PATH` if you prefer your own binaries.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The documentation mentions that the auto-builder for animated references works out-of-the-box on macOS and Linux. Since the project also bundles Windows binaries for ffmpeg/ffprobe, it would be helpful to mention that Windows is also supported for a zero-config experience to give Windows users confidence that the feature will work for them.

Suggested change
- `sora-cli` bundles ffmpeg and ffprobe, so the auto-builder works out of the box on macOS and Linux without additional setup. Set `SORA_CLI_FFMPEG_PATH` / `SORA_CLI_FFPROBE_PATH` if you prefer your own binaries.
- `sora-cli` bundles ffmpeg and ffprobe, so the auto-builder works out of the box on macOS, Linux, and Windows without additional setup. Set `SORA_CLI_FFMPEG_PATH` / `SORA_CLI_FFPROBE_PATH` if you prefer your own binaries.

Comment thread src/api/sora.ts Outdated
Comment on lines +56 to +64
function inferMimeType(pathLike: string): string | undefined {
const ext = extname(pathLike).toLowerCase();
if (ext === '.webp') return 'image/webp';
if (ext === '.png') return 'image/png';
if (ext === '.jpg' || ext === '.jpeg') return 'image/jpeg';
if (ext === '.gif') return 'image/gif';
if (ext === '.mp4') return 'video/mp4';
return undefined;
}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The inferMimeType function can be made more concise and easier to maintain by using a map/object for the extension-to-MIME-type mapping instead of a series of if statements.

function inferMimeType(pathLike: string): string | undefined {
  const ext = extname(pathLike).toLowerCase();
  const mimeMap: Record<string, string> = {
    '.webp': 'image/webp',
    '.png': 'image/png',
    '.jpg': 'image/jpeg',
    '.jpeg': 'image/jpeg',
    '.gif': 'image/gif',
    '.mp4': 'video/mp4',
  };
  return mimeMap[ext];
}

Comment thread src/reference/referenceBuilder.ts Outdated
`ffprobe ${basename(path)}`,
);

let info: any;

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

Using any for the ffprobe output (info) weakens type safety. Defining a specific interface for the expected JSON structure would make the code more robust, prevent potential runtime errors, and improve developer experience when working with this data. You only need to type the fields you access.

Suggested change
let info: any;
interface FfprobeStreamInfo {
nb_read_frames?: string;
nb_frames?: string;
avg_frame_rate?: string;
r_frame_rate?: string;
duration?: string;
}
interface FfprobeOutput {
streams?: FfprobeStreamInfo[];
}
let info: FfprobeOutput;

Comment thread src/state/jobService.ts Outdated
Comment on lines +523 to +537
function inferReferenceFormat(pathLike: string): 'webp' | 'png' | undefined {
const ext = extname(pathLike).toLowerCase();
if (ext === '.webp') return 'webp';
if (ext === '.png') return 'png';
return undefined;
}

function guessReferenceMime(pathLike: string, format?: 'webp' | 'png'): string {
if (format === 'webp') return 'image/webp';
if (format === 'png') return 'image/png';
const detected = inferReferenceFormat(pathLike);
if (detected === 'webp') return 'image/webp';
if (detected === 'png') return 'image/png';
return 'application/octet-stream';
}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The helper functions inferReferenceFormat and guessReferenceMime duplicate logic that is also present in src/api/sora.ts (inferMimeType). To improve maintainability and ensure a single source of truth, this logic should be consolidated into a shared utility file (e.g., src/utils/mime.ts) and imported where needed.

Comment thread src/ui/components/MultilineInput.tsx Outdated
Comment on lines +94 to +99
const result = moveVertical(originalValue, cursorOffset, -1);
if (result === null) {
nextCursorOffset = 0;
} else {
nextCursorOffset = result;
}

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

The previous implementation allowed the user to press the up-arrow on the first line of the prompt to loop focus to the last field in the form. This change removes that behavior, instead moving the cursor to the start of the input. This is a regression in keyboard navigation usability. Please consider restoring the onMoveOut(-1) call when moveVertical returns null to allow users to cycle through the form fields in both directions.

Suggested change
const result = moveVertical(originalValue, cursorOffset, -1);
if (result === null) {
nextCursorOffset = 0;
} else {
nextCursorOffset = result;
}
const result = moveVertical(originalValue, cursorOffset, -1);
if (result === null) {
onMoveOut?.(-1);
return;
}
nextCursorOffset = result;

@brennanmceachran
brennanmceachran merged commit 533bf92 into main Oct 10, 2025
1 check passed
@brennanmceachran
brennanmceachran deleted the feature/animated-reference branch October 10, 2025 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant