Saltar al cuntegna

Flux 3 Action

Integrar

ID dal model flux-3-action/so101
# Run the model; wait up to 20 s for the finished result in the same call
curl -X POST "https://vit.doitong.com/api/v1/run/flux-3-action/so101?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "prompt": "A red fox trots through fresh snow at sunrise, soft golden light, shallow depth of field",
    "scene_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "wrist_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "state": [
      -18.94,
      134.52,
      120.15,
      28.3,
      -32.17,
      27.02
    ]
  }'

# Still "queued" or "running"? Poll with the id from the response:
curl "https://vit.doitong.com/api/v1/requests/REQUEST_ID?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY"

Questa dumonda: ≈$0,003 3 credits API Lantschar sin questa pagina

Obtegna ina clav API
Black Forest Labs Video a video #robotic#arm

Model da politica da robot che prevesa blocs d'acziuns dal bratsch SO-101 dad frames da camera, stadi da las giuntas e in'instrucziun

Black Forest Labs · Datas (JSON)

Tes emprim resultat vegn qua

Construis ina dumonda sutvart e l'exequescha cun tia clav API. Outputs vegnan copiads en nossa memorisaziun, conservads per adina u 7 dis gratuitamain.

Construir ina dumonda

Ils controls vegnan generads dal schema dal model. Il code e ​​il pretsch s'actualiseschan durant che ti als midas.

•obligatori 88 / 2000

Instrucziuns per la lavur dal robot en lingua natirala.

•obligatori
Trametta in datoteca u

Maletg tile san che mussa il frame actual da la camera fixa da la scena suenter il rescalament a 256x256.

•obligatori
Trametta in datoteca u

Frame actual da la camera dal pols, mess en il tile dretg e rescalà a 256x256.

•obligatori

Valurs mesuradas dal stadi en quest urden: rotaziun ed elevaziun da la spatla, flexiun dal cumbel, flexiun e roll dal pols, tut en grads, suandadas da la posiziun dal pinz en pertschient.

Avanzà history_scene_image_url · history_wrist_image_url · num_inference_steps · guidance_scale · seed · state_history · command_history
Trametta in datoteca u

Input dal frame istoric da la scena cun `state_history` necessari; sche omess vegn utilisà il frame actual. Il frame furnì represchenta l'observaziun d'istorgia la pli veglia, 7 ticks enavos.

Trametta in datoteca u

Frame da la camera dal pols al tick d'istorgia il pli vegl; `state_history` è necessari.

standard 4

Dumber da pass da denoisaziun Euler; la validaziun dal checkpoint ha utilisà 4 pass.

standard 3

Furma da la guidance senza classificader per video ed acziun; metter a 1.0 per deactivar CFG.

Seed da sampling cun ils parameters da referenza da DROID: 0 e SO-101: 42. Sche betg inditgà, vegn elegì casualmain in seed.

Istorgia dal stadi mesurà, omessa per in episodi nov e per il rest cun `command_history` necessari. Furnir las mesiraziuns en urden cronologic per ils 7 control ticks immediatamain avant `state`, a 30 Hz.

Istorgia da cumonds absoluts cun `state_history` necessari; il cumond tramess il pli nov è en l'ultima lingia. Las lingias èn cronologicas sur 8 ticks d'observaziun e inditgan il cumond activ a mintga tick.

POST /run/flux-3-action/so101?wait=20 calculaziun → $0,003
# Run the model; wait up to 20 s for the finished result in the same call
curl -X POST "https://vit.doitong.com/api/v1/run/flux-3-action/so101?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "prompt": "A red fox trots through fresh snow at sunrise, soft golden light, shallow depth of field",
    "scene_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "wrist_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "state": [
      -18.94,
      134.52,
      120.15,
      28.3,
      -32.17,
      27.02
    ]
  }'

# Still "queued" or "running"? Poll with the id from the response:
curl "https://vit.doitong.com/api/v1/requests/REQUEST_ID?wait=20" \
  -H "Authorization: Bearer $DOITONG_API_KEY"

Executar questa dumonda

Tia clav resta en quest browser: ella vegn tramessa mo al Doitong API e memorisada (localStorage) mo sch'ella scheccas Tiar a memoria. Obtegnair ina clav API

Davart Flux 3 Action

Enstagl da medias, quai returna JSON cun las `actions` previsas, lur rata da controlla, las etichettas da colonnas e quants pass inizials d'exequir (`execute_steps`) avant da dumandar in nov bloc. Ils inputs obligatorics èn in `prompt` da text (fin a 2000 caracters), `scene_image_url`, `wrist_image_url` ed in `state` da 6 valurs. Inputs d'istorgia opziunals (`state_history`, `command_history`, imagens d'istorgia) dattan context temporal. `num_inference_steps` va da 1 a 8 e `guidance_scale` da 1 a 10.

Parameters

NumTip StandardPermess Descripziun
promptobligatori
Tipstring
≤ 2 000 caracters
Instrucziuns per la lavur dal robot en lingua natirala.
scene_image_urlobligatori
Tipurl · image
Maletg tile san che mussa il frame actual da la camera fixa da la scena suenter il rescalament a 256x256.
wrist_image_urlobligatori
Tipurl · image
Frame actual da la camera dal pols, mess en il tile dretg e rescalà a 256x256.
stateobligatori
Tipnumber[]
≤ 6 elements≥ 6 elements
Valurs mesuradas dal stadi en quest urden: rotaziun ed elevaziun da la spatla, flexiun dal cumbel, flexiun e roll dal pols, tut en grads, suandadas da la posiziun dal pinz en pertschient.
state_historyopziunal
Tiparray[]
≤ 7 elements≥ 7 elements
Istorgia dal stadi mesurà, omessa per in episodi nov e per il rest cun `command_history` necessari. Furnir las mesiraziuns en urden cronologic per ils 7 control ticks immediatamain avant `state`, a 30 Hz.
command_historyopziunal
Tiparray[]
≤ 8 elements≥ 8 elements
Istorgia da cumonds absoluts cun `state_history` necessari; il cumond tramess il pli nov è en l'ultima lingia. Las lingias èn cronologicas sur 8 ticks d'observaziun e inditgan il cumond activ a mintga tick.
history_scene_image_urlopziunal
Tipurl · image
Input dal frame istoric da la scena cun `state_history` necessari; sche omess vegn utilisà il frame actual. Il frame furnì represchenta l'observaziun d'istorgia la pli veglia, 7 ticks enavos.
history_wrist_image_urlopziunal
Tipurl · image
Frame da la camera dal pols al tick d'istorgia il pli vegl; `state_history` è necessari.
num_inference_stepsopziunal
Tipinteger
Standard4
1 – 8
Dumber da pass da denoisaziun Euler; la validaziun dal checkpoint ha utilisà 4 pass.
guidance_scaleopziunal
Tipnumber
Standard3
1 – 10
Furma da la guidance senza classificader per video ed acziun; metter a 1.0 per deactivar CFG.
seedopziunal
Tipinteger | null
Seed da sampling cun ils parameters da referenza da DROID: 0 e SO-101: 42. Sche betg inditgà, vegn elegì casualmain in seed.
obligatori

Ils parameters da datotecas acceptan ina URL publica https://, ina URI data: fin a 10 MB u il file_url d'ina chargiada. Datotecas

Output

GET /requests/req_8k2m4q7x1z9c3v5b6n0p2r4t
{
  "id": "req_8k2m4q7x1z9c3v5b6n0p2r4t",
  "object": "request",
  "model": "flux-3-action/so101",
  "status": "succeeded",
  "created_at": "2026-10-20T12:00:00Z",
  "started_at": "2026-10-20T12:00:02Z",
  "completed_at": "2026-10-20T12:00:09Z",
  "queue_position": null,
  "cost": {
    "credits": 3,
    "usd": "0.003",
    "charged": 3,
    "refunded": 0
  },
  "input": {
    "prompt": "A red fox trots through fresh snow at sunrise, soft golden light, shallow depth of field",
    "scene_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "wrist_image_url": "https://content.doitong.com/images/showcase/v3/gen_fox_cartoon.jpg",
    "state": [
      -18.94,
      134.52,
      120.15,
      28.3,
      -32.17,
      27.02
    ]
  },
  "output": {
    "actions": [
      [
        1.0
      ]
    ],
    "action_labels": [
      "string"
    ],
    "action_hz": 1.0,
    "execute_steps": 1,
    "seed": 42,
    "timings": {}
  },
  "outputs": [
    {
      "type": "file",
      "url": "https://content.doitong.com/dev-api/2026/10/20/req_8k2m4q7x1z9c3v5b6n0p2r4t/0-output.jpeg",
      "content_type": "image/jpeg",
      "file_size": 1843200,
      "stored": true
    }
  ],
  "error": null,
  "metrics": {
    "inference_seconds": 6.8
  },
  "urls": {
    "self": "https://vit.doitong.com/api/v1/requests/req_8k2m4q7x1z9c3v5b6n0p2r4t",
    "cancel": "https://vit.doitong.com/api/v1/requests/req_8k2m4q7x1z9c3v5b6n0p2r4t/cancel"
  }
}
Tias datotecas, tia decisiunMintga outputs[].url è ina copia en nossa memorisaziun: conservada per adina (pajà per GB-mes) u 7 dis gratuitamain, tenor la configuraziun dal conto u ?storage=.
La medema structura per mintga modeltype, url, content_type, width, height e duration, tant per maletgs sco per video e audio. output è l'object da resultat dal model sez.
Champs da l'output
actions
array of array of numberArray d'acziuns previsas cun lingias cronologicas che represchentan pass da control; las valurs n'èn betg limitadas, perquai ston ils limits da giugadiras, sveltezza e spazi da lavur vegnir applitgads al robot. A 30 Hz, SO-101 furnescha 42x6 cumonds absoluts en deg e pinz en %; a 15 Hz, DROID furnescha 32x8 mira da giugadiras absoluta en rad plus la part serrada dal pinz.
action_labels
array of stringNums correspundents a las colonnas d'acziun.
action_hz
numberFrequenza da control per las lingias d'acziun.
execute_steps
integerDumber d'acziuns inizialas d'exequir avant da dumandar in ulteriur bloc.
seed
integerSeed casual utilisà durant il sampling.
timings
objectMesiraziuns dal temp dal server, exprimidas en secundas.

Per agents AI: questa pagina sco Markdown è disponibla sut https://doitong.com/rm/developers/models/flux-3-action/so101.md. Tut ils models e las guidas: https://doitong.com/developers/llms.txt