Introduction to Labeling Tools

You are currently viewing the documentation for the latest version (2.6.1). To access a different version, click the "Switch version" button located in the upper-right corner of the page.

■ If you are not sure which version of the product you are currently using, please feel free to contact Mech-Mind Technical Support.

You can use labeling tools to label the images and hence provide data for deep learning training.

Please create labels of corresponding classes according to the needs of the current project before using labeling tools.

Polygon Tool

The Polygon Tool can draw polygon labels with more vertices, which is suitable for objects of complex shapes.

  1. Click tools introduction polygon icon (or press P on the keyboard).

  2. Click the first position (vertex) in the selection region, then click the second one, third one, etc., to draw the labels, and right-click to finish. (At least three vertices are required.)

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

After labeling, use the Select Tool to select a label and adjust the label by the following methods.

  • Click the label edges to increase the number of vertices.

  • Right-click a vertex to delete it.

  • Long press the left mouse button and drag the vertex in any direction to modify the label shape.

Ellipse Tool

Use more vertices to make elliptical selections. This tool is suitable for elliptical objects.

  1. Right-click tools introduction polygon icon and then click tools introduction oval icon (or press L on the keyboard).

  2. Long press the left mouse button in the selection region, move it in any direction, and then release the left mouse button to finish the ellipse selection.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Rectangle Tool

The Rectangle Tool can be used to draw rectangular labels, which is suitable for rectangular objects.

  1. Right-click tools introduction polygon icon and then click tools introduction rectangle icon (or press R on the keyboard).

  2. Long press the left mouse button in the selection region, move it in any direction, and then release the left mouse button to finish the rectangular selection.

  3. If multiple label classes are created, colors corresponding to different label classes should be selected.

Smart Labeling Tool

The Smart Labeling Tool can be used to automatically select the objects in the image. When multiple objects in an image have large color differences and are scattered, you can use the Smart Labeling Tool to conveniently label the objects in the image.

Currently, the Smart Labeling Tool can work in two modes, and it will automatically switch between them according to the actual situation. Users do not need to manually select a mode.

  • Standard mode (GPU): In this mode, the Smart Labeling Tool has robust labeling capabilities. This tool will automatically switch to the standard mode if the running device has a GPU, with available GPU memory of at least 2.5 GB, and there is no project undergoing training or validation.

  • Lite mode (CPU): In this mode, the Smart Labeling Tool has basic labeling capabilities. This tool will automatically switch to the lite mode if the running device has no GPU, or the available GPU memory is less than 2.5 GB, or there is a project undergoing training or validation.

Steps

  1. Click tools introduction smart labeling icon (or press A on the keyboard).

  2. Move the cursor in the selection region and then click the object to be labeled.

    • If the selection cannot completely cover the object, click the uncovered part to expand the selection area.

    • If the selection covers the areas outside the object, right-click these areas to reduce the selection area.

  3. Click Apply in the upper-left corner of the selection region.

You can use the Select Tool to fine-tune the labeled contour by the following steps:

  1. Use the Select Tool to select the label to be adjusted.

  2. Adjust the contour in one of the following three ways according to actual situation. Please ensure that the selected area closely aligns with the object contour.

    1. Place the mouse cursor on a vertex of the contour. When the cursor turns into tools introduction smart labeling change2, long-press the left mouse button and drag the vertex to adjust the contour.

    2. Place the mouse cursor on a vertex of the contour. When the cursor turns into tools introduction smart labeling change2, click the right mouse button to delete the vertex.

    3. Place the mouse cursor on the contour. When the cursor turns into tools introduction smart labeling change1, click the left mouse button to add a vertex.

When the objects differ greatly in colors and have clear contours, it is recommended that you label multiple objects at a time and click Apply. If the objects are not obviously distinct, it is recommended to label one at a time.

Labeling Settings

You can click the Settings button in the upper-left corner of the selection region to configure parameters for the Smart Labeling Tool. The smart labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

Pre-trained Labeling Tool

After you validate a model, you can import new image data to the current module and use the pre-trained labeling feature to perform auto-labeling based on this model.

The pre-trained labeling feature is available only when the current module contains validated models.

The Pre-trained Labeling Tool can be used only on the following three types of data:

  • Unlabeled data

  • Automatically labeled data (images with a yellow triangle at the front of the image number)

  • The Pre-trained Labeling Tool can only label images that are not manually labeled. If you need to use the Pre-trained Labeling Tool on manually labeled images, you must clear these labels first.

  • Data after a manual adjustment will have the yellow triangle marker removed. The data will be no longer available for pre-trained labeling and VFM labeling.

The pre-trained labeling feature can outstandingly reduce the cost of manual labeling. However, the accuracy of the results depends on the model that you use. We recommend that you train a high precision model before you use the pre-trained labeling feature.

You can use the Pre-trained Labeling Tool in one of the following three methods.

  • Method 1: Pre-trained labeling button

    1. On the upper part of the image list, click the Pre-trained labeling button. All images in the image list will be labeled by using the Pre-trained Labeling Tool.

    2. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 2: Pre-trained labeling option

    1. In the image list, select one or more images that you need to label.

    2. Right-click the images and select Pre-trained labeling, the labeling process starts. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 3: Pre-trained Labeling Tool

    1. In the labeling toolbar, right-click tools introduction smart labeling icon, then click tools pre labeling tool icon (or press D on the keyboard) to select the Pre-trained Labeling Tool.

    2. On the upper part of the image, click Start labeling, and the Pre-trained Labeling Tool will start to label the image. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

  • If you clear all labels of an image, the yellow triangle before it will be cleared.

  • In the Classification module, if you modify the class labels of an image, the yellow triangle before it will be cleared.

Labeling Settings

You can click the Settings button in the upper-left corner of the selection region to configure parameters for the Pre-trained Labeling Tool. The pre-trained labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

VFM Labeling Tool

Mech-DLK incorporates the visual foundation models (VFMs) developed by Mech-Mind. You can use the VFM Labeling Tool powered by the visual foundation models to quickly label datasets.

The VFM Labeling Tool can be used only on the following three types of data:

  • Unlabeled data

  • Automatically labeled data (images with a yellow triangle at the front of the image number)

  • To use the VFM Labeling Tool, the available GPU memory on the current device must be greater than 6 GB; otherwise, the model conversion may fail.

  • The VFM Labeling Tool can only label images that are not manually labeled. If you need to use the VFM Labeling Tool on manually labeled images, you must clear these labels first.

  • Data after a manual adjustment will have the yellow triangle marker removed. The data will be no longer available for pre-trained labeling and VFM labeling.

  • The first time you use VFM Labeling Tool, it may take a few minutes for the tool to get ready, please be patient.

You can use the VFM Labeling Tool in one of the following three methods.

  • Method 1: VFM labeling button

    1. On the upper part of the image list, click the VFM labeling button. All images in the image list will be VFM-labeled.

    2. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 2: VFM labeling option

    1. In the image list, select one or more images that you need to label.

    2. Right-click the images and select VFM labeling, the labeling process starts. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the labeled images.

  • Method 3: VFM Labeling Tool

    1. In the labeling toolbar, right-click tools introduction smart labeling icon, then click tools super labeling tool icon (or press S on the keyboard) to select the VFM Labeling Tool.

    2. On the upper part of the image, click Start labeling, and the VFM Labeling Tool will start to label the image. After the labeling process is finished, you can view a yellow triangle in the upper left corner of the sequence number of the image.

After the labeling is completed, Mech-DLK will generate a label class named "model_label" for the labels created by the visual foundation models.

If you want to modify VFM Labeling Settings, please follow those steps:

  1. Right-click on tools super labeling tool icon and select VFM Labeling Tool.

  2. Click labelling settings on the upper area of the labeling area.

  3. In the window of VFM Labeling Settings, you can modify the VFM labeling results.

Labeling Settings

You can click the Settings button in the upper-left corner of the selection region to configure parameters for the VFM Labeling Tool. The VFM labeling settings take effect for labels that are created after the settings are confirmed.

  • Contour vertex density: Specifies the density of vertices on the contour. Valid values: Standard and Sparse.

    • Standard: Generates more vertices for labels, providing higher precision when manually fine-tuning the contour.

    • Sparse: Generates fewer vertices for labels, suitable for objects with regular shapes that do not require fine-tuned labeling.

  • Label confidence: Filters labels with confidence higher than this value. Confidence indicates the accuracy of the labeling results. The higher the confidence, the more accurate the labeling results are.

    Settings the confidence too high may result in a lower number of displayed labels.

  • Max num of labeling objects: Specifies the maximum number of labels.

Template Tool

You can use the Template Tool to set an existing selection as a template. After setting, you can use this template to rapidly label contours and objects with the same pose.

It is suitable for scenarios where there are multiple neatly arranged objects of the same type in an image, which can improve labeling efficiency.

tools introduction seal

  1. Click tools introduction seal icon (or press C on the keyboard).

  2. Click the region that needs to be set as the template.

  3. Move the template to the object that you need to select, adjust the angle of the template to make it fit the object, and then click it.

    • Coarse adjustment: Press and hold the Shift key and then scroll the mouse wheel.

    • Fine adjustment: Adjust the Rotation angle parameter.

During labeling, press and hold the Ctrl key and click the selection to switch the template. You can also click Replace template and then click the selection to achieve the same purpose.

Mask Tool

If there are some irrelevant parts that may interfere with model training/inference, you can use the Mask Tool to cover such parts. The masked parts will not be involved in training/inference.

You can choose among the following three mask tools built in the software according to actual needs.

Mask Polygon Tool

  1. Click tools introduction mask polygon icon (or press Shift + P on the keyboard)

  2. Set “Fill” for the mask.

  3. Click the first position (vertex) in the selection area, then click the second one, third one, etc., to draw the labels, and right-click to finish.

Mask Brush Tool

  1. Right-click tools introduction mask polygon icon and then click tools introduction mask pen icon (or press Shift + B on the keyboard)

  2. Set the “Fill” of the mask and adjust the slider to determine the brush size.

  3. Long press the left mouse button in the selection area, move in any direction, and then release the left mouse button to finish the drawing.

Mask Lasso Tool

  1. Right-click tools introduction mask polygon icon and then click tools introduction mask lasso icon (or press Shift + N on the keyboard)

  2. Set “Fill” for the mask.

  3. Long press the left mouse button in the selection area and move in any direction to form closed shapes with the starting point.

Mask Eraser Tool

The Mask Eraser Tool can be used to erase the masks.

  1. Click tools introduction mask eraser icon (or press Shift + E on the keyboard)

  2. Long press the left mouse button in the selection area and move in any direction.

    Adjust the slider to change the eraser size.

ROI Tool

You can use the ROI Tool to set the region of interest.

Setting the ROI can avoid interferences from the background.

  1. Click tools introduction roi icon (or press O on the keyboard).

  2. Adjust the ROI frame in the selection region.

  3. Click the tools introduction OK button in the lower right corner of the ROI to save the setting, or click the tools introduction cancel button to disable the ROI Tool.

  4. Click the Reset button in the upper left corner of the image to reset the ROI.

Select Tool

You can use the Select Tool to select, move, and adjust the selections.

  1. Click tools introduction select icon (or press F on the keyboard).

  2. Move the cursor in the selection region and then click the selection to be processed.

  • Select multiple selections by pressing and holding the Ctrl key.

  • Right-click and drag in the labeling area to select all labels within the selected area.

Adjust size

tools introduction select1

Rotation

tools introduction select2

Move

tools introduction select3

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.

  • Preference
  • I accept
  • I don't accept