Overview

AI Dev Kit provides a collection of modular, fluent tasks to perform powerful AI actions directly within Unity. Each GENTask type is designed for a specific modality, with unified syntax and advanced customization support.


Task
Modality
In-Game Use Case

GENResponse

Text → Text

• Generate NPC responses based on player input

• Provide dynamic explanations, tips, or hints

• Fill in quest or item descriptions procedurally

• Create tutorial content on demand

GENObject<T>

Text → Struct

• Generate structured RPG content (items, quests, skills)

• Create abilities, traits, or status effects from prompts

• Dynamically configure missions or challenges

• Personalize background stories for characters

GENChat

Text → Chat Session

• Build persistent dialogue with an AI companion

• Implement an in-game AI assistant or narrator

• Maintain relationship-based memory in conversations

GENImage

Text → Image

• Generate dynamic concept art or loading screens

• Create emblems, icons, or signage from user prompts

• Style in-game UI elements with AI-generated images

• Offer an AI photo booth or custom illustration system

GENInpaint

Image + Text → Image

• Allow players to customize equipment or costumes

• Paint or edit world assets (e.g., walls, banners)

• Enable AI-assisted retouching in creative tools

• Fill in templates or incomplete artwork

GENVariation

Image → Image

• Create variations of user-uploaded avatars

• Generate multiple weapon/armor skins from one base

• Produce diverse appearances for procedural NPCs

• Implement a remix feature for visual assets

GENSpeech

Text → Audio

• Narrate events or dialogues using AI voices

• Play spoken instructions or tutorials

• Generate unique character voices at runtime

• Build interactive voiceovers for quests or narration

GENTranscript

Audio → Text

• Process player voice commands in-game

• Transcribe interviews, logs, or voice messages

• Support voice-based quest progression

• Store transcribed dialogue history

GENAudioIsolation

Audio → Clean audio

• Clean up player microphone input (e.g., multiplayer chat)

• Extract clean voice from noisy recordings

• Enhance the clarity of AI-dubbed voice logs

GENVideo

Text → Video

• Create AI-generated cutscenes or flashbacks

• Summarize gameplay moments as video

• Render stylized memory playback

• Build cinematic intros or trailers dynamically

Last updated