AIDevKit - AI Suite for Unity
API ReferencesDiscordGlitch9
  • Introduction
    • AI Dev Kit 3.7.0
    • Troubleshooting
    • FAQ
    • Update Logs
  • Provider Setup
    • API Key Setup
    • OpenAI
    • Google Gemini
    • ElevenLabs
    • Ollama
    • OpenRouter
  • Editor Tools
    • Introduction
    • Editor Chat
    • Model Library
    • Voice Library
  • GEN Tasks
    • Overview
    • Prefixes
    • Response
    • Chat
    • Image
    • Video
    • SoundFX
    • Speech
    • Transcript
    • Voice Change
    • Audio Isolation
    • Sequence
  • Advanced API (Pro)
    • Assistants
      • How it works
      • Creating custom functions
      • Creating assistants API
    • Realtime
  • Legacy API
    • OpenAI
      • 💬Chat completions
      • 🖼️Image operations
      • 🗣️Text to speech
      • 🎙️Speech to text
        • Recording real-time in Unity
      • 💾Files
      • 🔎Embeddings
      • 🛡️Moderations
      • ⚙️Fine-tuning
    • Google Gemini
      • 📝System instructions
      • 💬Text generation
      • ⚙️Fine-tuning
      • ▶️Fucntion calling
      • 🔎Embeddings
      • 🛡️Safety
      • 💻Code execution
  • Legacy Documents
    • AI Dev Kit 1.0
      • Preperation
      • Scriptable Toolkits
        • Chat Streamer
        • Image Generator
        • Voice Transcriber
        • Voice Generator
      • Editor Tools
      • Troubleshooting (Legacy)
        • ❗Build Error: The name 'UnityMenu' does not exist in the current context
        • ❗The type or namespace name 'AndroidJavaObject' could not be found
        • ❗The type or namaspace name 'Plastic' does not exist
        • ❗Build Error: The name 'Asset Database' does not exist in the current context
        • ❗'ModelData.Create(Provider, string, UnixTime?, string)': not all code paths return a value
      • Code Generators
        • C# Script Generator
        • Unity Component Generator
    • AI Dev Kit 2.0
      • Event Handlers
      • Editor Chat
      • Editor Vision (TTI, ITI)
      • Editor Speech (TTS)
      • Management Tools
        • Prompt History Viewer
        • AI Model Manager
        • TTS Voice Manager
        • OpenAI File Manager
        • OpenAI Assistant Manager
        • ElevenLabs Voice Library
Powered by GitBook
On this page
  1. GEN Tasks

Overview

AI Dev Kit provides a collection of modular, fluent tasks to perform powerful AI actions directly within Unity. Each GENTask type is designed for a specific modality, with unified syntax and advanced customization support.


Task
Modality
In-Game Use Case

GENResponse

Text → Text

• Generate NPC responses based on player input

• Provide dynamic explanations, tips, or hints

• Fill in quest or item descriptions procedurally

• Create tutorial content on demand

GENObject<T>

Text → Struct

• Generate structured RPG content (items, quests, skills)

• Create abilities, traits, or status effects from prompts

• Dynamically configure missions or challenges

• Personalize background stories for characters

GENChat

Text → Chat Session

• Build persistent dialogue with an AI companion

• Implement an in-game AI assistant or narrator

• Maintain relationship-based memory in conversations

GENImage

Text → Image

• Generate dynamic concept art or loading screens

• Create emblems, icons, or signage from user prompts

• Style in-game UI elements with AI-generated images

• Offer an AI photo booth or custom illustration system

GENInpaint

Image + Text → Image

• Allow players to customize equipment or costumes

• Paint or edit world assets (e.g., walls, banners)

• Enable AI-assisted retouching in creative tools

• Fill in templates or incomplete artwork

GENVariation

Image → Image

• Create variations of user-uploaded avatars

• Generate multiple weapon/armor skins from one base

• Produce diverse appearances for procedural NPCs

• Implement a remix feature for visual assets

GENSpeech

Text → Audio

• Narrate events or dialogues using AI voices

• Play spoken instructions or tutorials

• Generate unique character voices at runtime

• Build interactive voiceovers for quests or narration

GENTranscript

Audio → Text

• Process player voice commands in-game

• Transcribe interviews, logs, or voice messages

• Support voice-based quest progression

• Store transcribed dialogue history

GENAudioIsolation

Audio → Clean audio

• Clean up player microphone input (e.g., multiplayer chat)

• Extract clean voice from noisy recordings

• Enhance the clarity of AI-dubbed voice logs

GENVideo

Text → Video

• Create AI-generated cutscenes or flashbacks

• Summarize gameplay moments as video

• Render stylized memory playback

• Build cinematic intros or trailers dynamically

PreviousVoice LibraryNextPrefixes

Last updated 6 hours ago