VideoFile

VideoFile extends File and provides additional methods for working with video files.

VideoFile instances are created when a DataChain is initialized from storage with the type="video" parameter:

from datachain import DataChain

dc = DataChain.from_storage("s3://bucket-name/", type="video")

There are additional models for working with video files:

• VideoFrame - represents a single frame of a video file.
• VideoFragment - represents a fragment of a video file.

These are virtual models that do not create physical files. Instead, they are used to represent the data in the VideoFile these models are referring to. If you need to save the data, you can use the save method of these models, allowing you to save data locally or upload it to a storage service.

VideoFile

VideoFile(**kwargs)

Bases: File

A data model for handling video files.

This model inherits from the File model and provides additional functionality for reading video files, extracting video frames, and splitting videos into fragments.

Source code in datachain/lib/file.py

def __init__(self, **kwargs):
    super().__init__(**kwargs)
    self._catalog = None
    self._caching_enabled: bool = False

get_fragment

get_fragment(start: float, end: float) -> VideoFragment

Returns a video fragment from the specified time range.

Parameters:

• start (float) –

  The start time of the fragment in seconds.

• end (float) –

  The end time of the fragment in seconds.

Returns:

• VideoFragment ( VideoFragment ) –

  A Model representing the video fragment.

Source code in datachain/lib/file.py

def get_fragment(self, start: float, end: float) -> "VideoFragment":
    """
    Returns a video fragment from the specified time range.

    Args:
        start (float): The start time of the fragment in seconds.
        end (float): The end time of the fragment in seconds.

    Returns:
        VideoFragment: A Model representing the video fragment.
    """
    if start < 0 or end < 0 or start >= end:
        raise ValueError(f"Invalid time range: ({start:.3f}, {end:.3f})")

    return VideoFragment(video=self, start=start, end=end)

get_fragments

get_fragments(
    duration: float,
    start: float = 0,
    end: Optional[float] = None,
) -> Iterator[VideoFragment]

Splits the video into multiple fragments of a specified duration.

Parameters:

• duration (float) –

  The duration of each video fragment in seconds.

• start (float, default: 0 ) –

  The starting time in seconds (default: 0).

• end (float, default: None ) –

  The ending time in seconds. If None, the entire remaining video is processed (default: None).

Returns:

• Iterator[VideoFragment] –

  Iterator[VideoFragment]: An iterator yielding video fragments.

Note

If end is not specified, number of frames will be taken from the video file, this means video file needs to be downloaded.

Source code in datachain/lib/file.py

def get_fragments(
    self,
    duration: float,
    start: float = 0,
    end: Optional[float] = None,
) -> "Iterator[VideoFragment]":
    """
    Splits the video into multiple fragments of a specified duration.

    Args:
        duration (float): The duration of each video fragment in seconds.
        start (float): The starting time in seconds (default: 0).
        end (float, optional): The ending time in seconds. If None, the entire
                               remaining video is processed (default: None).

    Returns:
        Iterator[VideoFragment]: An iterator yielding video fragments.

    Note:
        If end is not specified, number of frames will be taken from the video file,
        this means video file needs to be downloaded.
    """
    if duration <= 0:
        raise ValueError("duration must be a positive float")
    if start < 0:
        raise ValueError("start must be a non-negative float")

    if end is None:
        end = self.get_info().duration

    if end < 0:
        raise ValueError("end must be a non-negative float")
    if start >= end:
        raise ValueError("start must be less than end")

    while start < end:
        yield self.get_fragment(start, min(start + duration, end))
        start += duration

get_frame

get_frame(frame: int) -> VideoFrame

Returns a specific video frame by its frame number.

Parameters:

• frame (int) –

  The frame number to read.

Returns:

• VideoFrame ( VideoFrame ) –

  Video frame model.

Source code in datachain/lib/file.py

def get_frame(self, frame: int) -> "VideoFrame":
    """
    Returns a specific video frame by its frame number.

    Args:
        frame (int): The frame number to read.

    Returns:
        VideoFrame: Video frame model.
    """
    if frame < 0:
        raise ValueError("frame must be a non-negative integer")

    return VideoFrame(video=self, frame=frame)

get_frames

get_frames(
    start: int = 0, end: Optional[int] = None, step: int = 1
) -> Iterator[VideoFrame]

Returns video frames from the specified range in the video.

Parameters:

• start (int, default: 0 ) –

  The starting frame number (default: 0).

• end (int, default: None ) –

  The ending frame number (exclusive). If None, frames are read until the end of the video (default: None).

• step (int, default: 1 ) –

  The interval between frames to read (default: 1).

Returns:

• Iterator[VideoFrame] –

  Iterator[VideoFrame]: An iterator yielding video frames.

Note

If end is not specified, number of frames will be taken from the video file, this means video file needs to be downloaded.

Source code in datachain/lib/file.py

def get_frames(
    self,
    start: int = 0,
    end: Optional[int] = None,
    step: int = 1,
) -> "Iterator[VideoFrame]":
    """
    Returns video frames from the specified range in the video.

    Args:
        start (int): The starting frame number (default: 0).
        end (int, optional): The ending frame number (exclusive). If None,
                             frames are read until the end of the video
                             (default: None).
        step (int): The interval between frames to read (default: 1).

    Returns:
        Iterator[VideoFrame]: An iterator yielding video frames.

    Note:
        If end is not specified, number of frames will be taken from the video file,
        this means video file needs to be downloaded.
    """
    from .video import validate_frame_range

    start, end, step = validate_frame_range(self, start, end, step)

    for frame in range(start, end, step):
        yield self.get_frame(frame)

get_info

get_info() -> Video

Retrieves metadata and information about the video file.

Returns:

• Video ( Video ) –

  A Model containing video metadata such as duration, resolution, frame rate, and codec details.

Source code in datachain/lib/file.py

def get_info(self) -> "Video":
    """
    Retrieves metadata and information about the video file.

    Returns:
        Video: A Model containing video metadata such as duration,
               resolution, frame rate, and codec details.
    """
    from .video import video_info

    return video_info(self)

VideoFrame

Bases: DataModel

A data model for representing a video frame.

This model inherits from the VideoFile model and adds a frame attribute, which represents a specific frame within a video file. It allows access to individual frames and provides functionality for reading and saving video frames as image files.

Attributes:

• video (VideoFile) –

  The video file containing the video frame.

• frame (int) –

  The frame number referencing a specific frame in the video file.

get_np

get_np() -> ndarray

Returns a video frame from the video file as a NumPy array.

Returns:

• ndarray ( ndarray ) –

  A NumPy array representing the video frame, in the shape (height, width, channels).

Source code in datachain/lib/file.py

def get_np(self) -> "ndarray":
    """
    Returns a video frame from the video file as a NumPy array.

    Returns:
        ndarray: A NumPy array representing the video frame,
                 in the shape (height, width, channels).
    """
    from .video import video_frame_np

    return video_frame_np(self.video, self.frame)

read_bytes

read_bytes(format: str = 'jpg') -> bytes

Returns a video frame from the video file as image bytes.

Parameters:

• format (str, default: 'jpg' ) –

  The desired image format (e.g., 'jpg', 'png'). Defaults to 'jpg'.

Returns:

• bytes ( bytes ) –

  The encoded video frame as image bytes.

Source code in datachain/lib/file.py

def read_bytes(self, format: str = "jpg") -> bytes:
    """
    Returns a video frame from the video file as image bytes.

    Args:
        format (str): The desired image format (e.g., 'jpg', 'png').
                      Defaults to 'jpg'.

    Returns:
        bytes: The encoded video frame as image bytes.
    """
    from .video import video_frame_bytes

    return video_frame_bytes(self.video, self.frame, format)

save

save(output: str, format: str = 'jpg') -> ImageFile

Saves the current video frame as an image file.

If output is a remote path, the image file will be uploaded to remote storage.

Parameters:

• output (str) –

  The destination path, which can be a local file path or a remote URL.

• format (str, default: 'jpg' ) –

  The image format (e.g., 'jpg', 'png'). Defaults to 'jpg'.

Returns:

• ImageFile ( ImageFile ) –

  A Model representing the saved image file.

Source code in datachain/lib/file.py

def save(self, output: str, format: str = "jpg") -> "ImageFile":
    """
    Saves the current video frame as an image file.

    If `output` is a remote path, the image file will be uploaded to remote storage.

    Args:
        output (str): The destination path, which can be a local file path
                      or a remote URL.
        format (str): The image format (e.g., 'jpg', 'png'). Defaults to 'jpg'.

    Returns:
        ImageFile: A Model representing the saved image file.
    """
    from .video import save_video_frame

    return save_video_frame(self.video, self.frame, output, format)

VideoFragment

Bases: DataModel

A data model for representing a video fragment.

This model inherits from the VideoFile model and adds start and end attributes, which represent a specific fragment within a video file. It allows access to individual fragments and provides functionality for reading and saving video fragments as separate video files.

Attributes:

• video (VideoFile) –

  The video file containing the video fragment.

• start (float) –

  The starting time of the video fragment in seconds.

• end (float) –

  The ending time of the video fragment in seconds.

save

save(
    output: str, format: Optional[str] = None
) -> VideoFile

Saves the video fragment as a new video file.

If output is a remote path, the video file will be uploaded to remote storage.

Parameters:

• output (str) –

  The destination path, which can be a local file path or a remote URL.

• format (str, default: None ) –

  The output video format (e.g., 'mp4', 'avi'). If None, the format is inferred from the file extension.

Returns:

• VideoFile ( VideoFile ) –

  A Model representing the saved video file.

Source code in datachain/lib/file.py

def save(self, output: str, format: Optional[str] = None) -> "VideoFile":
    """
    Saves the video fragment as a new video file.

    If `output` is a remote path, the video file will be uploaded to remote storage.

    Args:
        output (str): The destination path, which can be a local file path
                      or a remote URL.
        format (str, optional): The output video format (e.g., 'mp4', 'avi').
                                If None, the format is inferred from the
                                file extension.

    Returns:
        VideoFile: A Model representing the saved video file.
    """
    from .video import save_video_fragment

    return save_video_fragment(self.video, self.start, self.end, output, format)

Video

Bases: DataModel

A data model representing metadata for a video file.

Attributes:

• width (int) –

  The width of the video in pixels. Defaults to -1 if unknown.

• height (int) –

  The height of the video in pixels. Defaults to -1 if unknown.

• fps (float) –

  The frame rate of the video (frames per second). Defaults to -1.0 if unknown.

• duration (float) –

  The total duration of the video in seconds. Defaults to -1.0 if unknown.

• frames (int) –

  The total number of frames in the video. Defaults to -1 if unknown.

• format (str) –

  The format of the video file (e.g., 'mp4', 'avi'). Defaults to an empty string.

• codec (str) –

  The codec used for encoding the video. Defaults to an empty string.