Segmentation Assistant for ROItool (nnInteractive)

Nora Interactive Segmentation Assistant

 

This toolassistant usesallows users to create and refine 3D ROIs using interactions. Images, masks, and successive interactions are processed by a deep learning model hosted on a remote neuralserver.

network

The servercurrent version of the model is nnInteractive (Isensee, Rokuss, Krämer et. al., 2025). nnInteractive repository

1. Usage

First, select an ROI from the ROI list to assistmake manualit the active target for segmentation.

Point Interaction

• Click the Point icon (crosshairs) to activate Point mode
• Left-click on the image to add a positive point (to include an area)
• Right-click on the image to add a negative point (to exclude an area)
• The segmentation tasks.
  
  
  will

  

  be

  ---

  updated immediately. Click the icon again to deactivate
• To add multiple points before updating the segmentation, hold down the Q key while adding points. Release the Q key to send all accumulated points at once

1.Scribble Interaction

• Click the Scribble icon to activate Scribble mode and draw a scribble on the image
• Click the + button to run a positive interaction (add areas)
• Click the - button to run a negative interaction (remove areas)
• Scribbles are cleared after each interaction, allowing you to add more

BBox Interaction

• Click the BBox icon (square) to activate Bounding Box mode and draw a box on the image
• Click the + button for a positive interaction (segment inside the box)
• Click the - button for a negative interaction (exclude area in the box)
• The box is cleared after each interaction

Reset Interactions

• When editing the same ROI, all previous interactions are kept in memory server-side to guide the segmentation
• Click the Reset icon (eraser) to erase all previous interactions and start fresh

2. Server Setup

The segmentation server must be running, typically on a machine with a GPU.
 First, navigate to the src/python/segmentation_serversegmentation_assistant_server directory and launch the setup.sh script (requires internet access):

cd src/python/segmentation_serversegmentation_assistant_server
./setup.sh