Skip to content

Overview

typed-ffmpeg

CI Package Documentation PyPI Version codecov

typed-ffmpeg offers a modern, Pythonic interface to FFmpeg, providing extensive support for complex filters with detailed typing and documentation. Inspired by ffmpeg-python, this package enhances functionality by addressing common limitations, such as lack of IDE integration and comprehensive typing, while also introducing new features like JSON serialization of filter graphs and automatic FFmpeg validation.

Table of Contents

Features

typed-ffmpeg

  • Zero Dependencies: Built purely with the Python standard library, ensuring maximum compatibility and security.
  • User-Friendly: Simplifies the construction of filter graphs with an intuitive Pythonic interface.
  • Comprehensive FFmpeg Filter Support: Out-of-the-box support for most FFmpeg filters, with IDE auto-completion.
  • Integrated Documentation: In-line docstrings provide immediate reference for filter usage, reducing the need to consult external documentation.
  • Robust Typing: Offers static and dynamic type checking, enhancing code reliability and development experience.
  • Filter Graph Serialization: Enables saving and reloading of filter graphs in JSON format for ease of use and repeatability.
  • Graph Visualization: Leverages graphviz for visual representation, aiding in understanding and debugging.
  • Validation and Auto-correction: Assists in identifying and fixing errors within filter graphs.
  • Input and Output Options Support: Provide a more comprehensive interface for input and output options, including support for additional codecs and formats.
  • Partial Evaluation: Enhance the flexibility of filter graphs by enabling partial evaluation, allowing for modular construction and reuse.

Planned Features

Please note that the following features are under consideration or development for future releases:

  • Extended FFmpeg Version Support: While typed-ffmpeg is currently built with FFmpeg version 6.0 in mind, we are working to ensure compatibility across different FFmpeg versions. Feedback and issue reports are welcome to improve version support.
  • Additional Filter Support: We aim to expand the range of FFmpeg filters supported by typed-ffmpeg. Continuous updates will be made to include more complex and varied filters.

Installation

To install typed-ffmpeg, simply use pip:

pip install typed-ffmpeg

Note: FFmpeg must be installed on your system.

Note: If you need to install ffmpeg-python at the same time, use pip install typed-ffmpeg-compatible to prevent conflicts with the module name.​

Visualization Support

To enable graph visualization features:

pip install 'typed-ffmpeg[graph]'

Note: This requires Graphviz to be installed on your system.

Quick Usage

Here's how to quickly start using typed-ffmpeg:

import ffmpeg

# Flip video horizontally and output
f = (
    ffmpeg
    .input(filename='input.mp4')
    .hflip()
    .output(filename='output.mp4')
)
f

svg

For a more complex example:

import ffmpeg.filters
import ffmpeg

# Complex filter graph example
in_file = ffmpeg.input("input.mp4")
overlay_file = ffmpeg.input("overlay.png")

f = (
    ffmpeg.filters
    .concat(
        in_file.trim(start_frame=10, end_frame=20),
        in_file.trim(start_frame=30, end_frame=40),
    )
    .video(0)
    .overlay(overlay_file.hflip())
    .drawbox(x="50", y="50", width="120", height="120", color="red", thickness="5")
    .output(filename="out.mp4")
)
f

svg

See the Usage section in our documentation for more examples and detailed guides.

Acknowledgements

This project was initially inspired by the capabilities of GPT-3, with the original concept focusing on using GPT-3 to generate an FFmpeg filter SDK directly from the FFmpeg documentation. However, during the development process, I encountered limitations with GPT-3's ability to fully automate this task.

As a result, I shifted to traditional code generation methods to complete the SDK, ensuring a more robust and reliable tool. Despite this change in approach, both GitHub Copilot and GPT-3 were instrumental in accelerating the development process, providing valuable insights and saving significant time.

I would also like to extend my gratitude to the ffmpeg-python project, which inspired this project significantly. The API style and design ideas from ffmpeg-python have been influential, and I have utilized these aspects to shape the development of our SDK.

This project is dedicated to my son, Austin, on his seventh birthday (February 24, 2024), whose curiosity and zest for life continually inspire me.

Feel free to check the Documentation for detailed information and more advanced features.