π‘ Tips:
π§Έ Upload an image, and you can use the drawing toolβοΈ to highlight the areas you're interested in.
π For single-object caption mode, simply select the area and click the 'Generate Caption' button to receive a caption for the object.
π In QA mode, you can generate multiple masks by clicking the 'Generate Mask' button multiple times. Afterward, use the corresponding object id to ask questions.
π Click the button 'Clear Masks' to clear the current generated masks.
π‘ Tips:
β οΈ For video mode, we only support masking on the first frame in this demo.
π§Έ Upload an video, and you can use the drawing toolβοΈ to highlight the areas you're interested in the first frame.
π For single-object caption mode, simply select the area and click the 'Generate Caption' button to receive a caption for the object.
π In QA mode, you can generate multiple masks by clicking the 'Generate Mask' button multiple times. Afterward, use the corresponding object id to ask questions.
π Click the button 'Clear Masks' to clear the current generated masks.