package
0.40.0-beta
Repository: https://github.com/instill-ai/pipeline-backend.git
Documentation: pkg.go.dev

# README


title: "Archetype AI" lang: "en-US" draft: false description: "Learn about how to set up a VDP Archetype AI component https://github.com/instill-ai/instill-core"

The Archetype AI component is an AI component that allows users to connect the AI models served on the Archetype AI Platform. It can carry out the following tasks:

Release Stage

Alpha

Configuration

The component definition and tasks are defined in the definition.json and tasks.json files respectively.

Setup

In order to communicate with Archetype AI, the following connection details need to be provided. You may specify them directly in a pipeline recipe as key-value pairs within the component's setup block, or you can create a Connection from the Integration Settings page and reference the whole setup as setup: ${connection.<my-connection-id>}.

FieldField IDTypeNote
API Key (required)api-keystringFill in your Archetype AI API key

Supported Tasks

Describe

Describe a video.

InputIDTypeDescription
Task ID (required)taskstringTASK_DESCRIBE
Query (required)querystringA guide to describe the video
File IDs (required)file-idsarray[string]The IDs of the videos to describe. These must have been previously uploaded via TASK_UPLOAD_FILE.
OutputIDTypeDescription
Descriptionsdescriptionsarray[object]A set of descriptions corresponding to different moments in the video
Output Objects in Describe

Descriptions

FieldField IDTypeNote
DescriptiondescriptionstringThe description of the frame
Frame IDframe-idintegerThe frame number in the video that is being described
TimestamptimestampnumberThe moment of the video (in seconds since the start) that is being described

Summarize

Summarize the image.

InputIDTypeDescription
Task ID (required)taskstringTASK_SUMMARIZE
Query (required)querystringA guide to summarize the image
File IDs (required)file-idsarray[string]The IDs of the images to summarize. These must have been previously uploaded via TASK_UPLOAD_FILE.
OutputIDTypeDescription
ResponseresponsestringA text responding to the query

Upload File

Upload file.

InputIDTypeDescription
Task ID (required)taskstringTASK_UPLOAD_FILE
File (required)filestringThe file to upload. Accepted formats are JPEG and PNG for images or MP4 for videos
OutputIDTypeDescription
File IDfile-idstringThe ID to reference the file in queries

# Functions

Init returns an implementation of IConnector that interacts with Archetype AI.