Structured-Light 3D Camera

Description

Use this Step to control structured-light 3D cameras for data acquisition or load locally stored data.

This Step is usually the first Step of a Mech-MSR project, which is used to connect Mech-Eye industrial 3D camera (hereinafter referred to as the “camera”) for image data acquisition.

Workflow

The process of configuring this Step is shown below:

structured light 3d camera workflow

  1. Choose to Use Real Camera or Read Local Files.

  2. Connect the camera or select the local data path according to the real situation.

  3. Set Parameters.

  4. Run the Step and view output.

Use Real Camera

Workflow

  1. Drag the Structured-Light 3D Camera into the graphical programming workspace.

  2. Under Parameters, find Camera ID, click the Select camera button to open the Choose the camera and calibration parameter group to use window.

  3. Find the camera to connect in the list, hover the cursor over the target camera ID, and click 3d laser profiler icon to connect to the camera.

    If 3d laser profiler icon becomes 3d laser profiler icon 1, the camera is connected successfully.

  4. After the camera is connected successfully, you can select the calibration parameter group in the drop-down list of Calibration Parameter Group and then click the OK button in the lower right corner of the window. Part of the Parameters section will be automatically updated.

  5. Set Parameters.

  6. Run this Step to connect to the camera and acquire data.

Read Local Files

Preparations

Use the camera to acquire and save data. For related operations, refer to Acquire and View Data and Save Data instructions.

Workflow

  1. Drag the Structured-Light 3D Camera Step to the graphical programming workspace and enable Virtual Mode under Parameters in the parameter configuration panel.

  2. Click 3d laser profiler flod icon under Data Path.

  3. In the pop-up window, browse and select the folder where the data is saved and then click the Select Folder button.

    • In the virtual mode, the naming and the format of the file should meet the requirements below, and the serial number of the color image should be the same as its depth map counterpart.

      • Color images: rgb_image_xxxx.jpg;

      • Depth maps: depth_image_xxxx.png.

    • If any one of the following descriptions is true when you select the data path, a virtual camera assistant will be triggered to help you select the image data.

      • You have not entered a path in the data path box;

      • There are multiple sets of data in the selected folder;

      • There is no color image, depth map, or intrinsic and extrinsic parameters in the selected folder.

        In the Virtual Camera Assistant window, you need to select the data path:

        1. Select Calibration Parameter Group Path and click the Verify button, then a Camera parameter group updated message will appear.

        2. Select the path of the depth map and color image. Then, click the OK button after selecting the data.

  4. Set Parameters.

  5. Run this Step to load the locally saved data.

Parameters

Parameter Description

Camera Type

Only Mech-Eye is supported, i.e. the Mech-Eye industrial 3D camera.

Virtual Mode

It is not enabled by default. If you need to run the project with the locally saved data, you can enable the Virtual Mode, and select settings under the virtual mode.

Camera ID

Confirm the ID of the camera to be connected. Click the Select camera button, and select the camera to connect. Please refer to Workflow for detailed instructions.

Camera Model

The model information of current camera. See detailed information in Camera Models.

Calibration Parameter Group

The calibration parameter group used by the selected camera.

Configuration Parameter Group

The parameter group configured in Mech-Eye Viewer. The camera will acquire data according to the parameters in the configuration parameter group.

Num of Reconnection Attempts

Use this parameter to specify the maximum number of attempts to reconnect the camera if the software fails to connect to the camera within the timeout period. The default value is 3.

IP address

The IP address of the camera.

This parameter will be automatically updated after the camera is connected. Do not make any modification, otherwise the camera will be disconnected.

Timeout

This parameter is used to set the maximum response timeout period, in milliseconds (ms), from the camera receives the data to it sends the data to the client. The two types of timeout are as follows:

  • The camera fails to be connected successfully within the set time.

  • The camera fails to capture any images within the set time.

Default value: 10000 ms

Max Capture Attempts

The total number of attempts to capture the image if the camera fails to capture any image within the timeout period.

Auto Calc Projection Parameters

Point cloud data can be converted into surface data (including depth maps and intensity images) through orthogonal projection. When the parameter is selected, the system will automatically calculate the projection-related parameters each time the step is executed, which will increase the computational cost.

The projection parameters are as follows:

  • Resolution

    The X- and Y-axis resolution of the projected image, which refers to the distance between two neighboring points in the X- or Y-direction.

  • Min X

    Points with an X value smaller than this value will be discarded during the projection process.

  • Min Y

    Points with an Y value smaller than this value will be discarded during the projection process.

  • Max X

    Points with an X value greater than this value will be discarded during the projection process.

  • Max Y

    Points with an Y value greater than this value will be discarded during the projection process.

  • Z-Direction Translation

    Translate the Z-coordinate of each data point by a certain distance along the Z-axis.

Parameters Visible Only in Virtual Mode

Parameter Description

Playback Mode

This parameter is used to specify the order to read the images.

Options:

  • Sequential (default): Read the images in the order of the images in the folder.

  • Repeat one: Read the current image repeatedly.

  • Repeat all: Read all images in the order of the images in the folder and then read them from the beginning after all images are read.

  • Random: Read images randomly.

Please select the mode according to the image reading order you need.

Current Frame Name

This parameter is used to read the name of the currently loaded image.

Output Description

The output of this Step is the surface data including depth map and intensity image that can be used as input to other Steps.

Troubleshooting

  • For common errors, see Error Code List.

  • If the error code is inconsistent with the error message, please contact technical support for help.

CV-E0201

Error: Failed to connect to the camera.

Possible Causes:

  1. The cable connection between the camera, IPC, and router/switch was abnormal.

  2. Firewalls or antivirus software were not shut down.

  3. The IP address of the camera was modified.

  4. Multiple Ethernet ports of the computer had IP addresses in the same subnet.

Solutions:

  1. Make sure that the cables are properly connected.

  2. Disable the computer firewall or add Mech-MSR to the computer firewall whitelist, then disable the antivirus software.

  3. Make sure that the camera’s IP address is correct.

  4. Disable other Ethernet ports on the computer that are not used for camera connections, then run Mech-MSR and reconnect the camera.

If none of the above steps work, and the camera still cannot be detected, try power-cycling the camera.

CV-E0202

Error: Camera XXX has no access permission.

Solution: Please check the logs and ensure that the network and camera firmware are functioning properly before trying again. If the issue persists, please contact Technical Support.

CV-E0203

Error: Failed to connect to the camera: XXX. The camera is not responding.

Possible cause: The IP and the port of the camera are incorrect.

Solution: Please check if the IP and the port of the camera are correct.

CV-E0204

Error: Failed to connect to the camera: XXX. Camera is connected by a third-party software through the GenICam interface.

Solution: Ensure the camera is not connected by a third-party software through the GenICam interface.

CV-E0205

Error: The camera firmware of the current version is not supported.

Solution: Please upgrade the camera firmware before using Mech-Eye Viewer to connect to the camera.

CV-E0206

Error: Failed to initialize the data acquisition device due to an internal error.

Solution: Please contact Technical Support.

CV-E0207

Error: No data acquisition device is connected.

Solution: Please connect a device first.

CV-E0208

Error: Failed to connect to the data acquisition device.

Solutions:

  • Make sure the data acquisition device is available for connection.

  • Make sure the IPC and the data acquisition device are on the same subnet.

  • Close all software that may be occupying the data acquisition device.

  • Turn off the firewall, or allow Mech-MSR through the firewall.

CV-E0211

Error: Failed to obtain the parameters of the data acquisition device due to an internal error.

Solution: Please contact Technical Support.

CV-E0212

Error: An internal error occurred.

Solution: Please contact Technical Support.

CV-E0213

Error: Failed to read the camera parameters from files due to an internal error.

Solution: Please contact Technical Support.

CV-E0214

Error: Failed to write the camera parameters into files due to an internal error.

Solution: Please contact Technical Support.

CV-E0215

Error: Failed to acquire color image or depth map.

Possible Causes:

  • The network connection is abnormal.

  • There is a problem in the “Timeout” parameter setting.

Solutions:

  • Check and ensure that the network connection is functioning properly.

  • Adjust the “Timeout” parameter.

  • Restart the software or camera.

  • If the issue persists, please contact Technical Support.

CV-E0216

Error: Error in image post-treatment.

Possible Cause: The size of the color image and the depth map are inconsistent.

Solution: Please check the parameter settings of the camera and acquire image data again. If the issue still exists, please contact Technical Support.

CV-E0217

Error: The image size does not match the settings specified in the extrinsic parameter file.

Possible Cause: Wrong camera parameter settings.

Solution: Please check the parameter settings of the camera and acquire image data again. If the issue still exists, please contact Technical Support.

CV-E0218

Error: The depth values of images are all NaN.

Possible Causes:

  1. Insufficient camera exposure.

  2. The target object is outside the camera’s working distance.

  3. The camera’s position is incorrect.

Solutions:

  1. Adjust the camera exposure settings or increase the lighting.

  2. Make sure the target object is within the camera’s working distance.

  3. Calibrate or adjust the camera’s position.

CV-E0261

Error: Failed to connect to the data acquisition device.

Possible Causes:

  1. The data acquisition device was not connected to the IPC.

  2. The entered IP address did not correspond to a Mech-Eye device.

Solutions:

  1. Ensure the data acquisition device is connected to the IPC.

  2. Verify that the entered IP address corresponds to a Mech-Eye device.

CV-E0262

Error: The data acquisition device is offline.

Possible cause: Network connection failed.

Solution: Check the network connection and try again.

CV-E0263

Error: The operation is not supported.

Possible Causes:

  1. The camera firmware version is incompatible with the Mech-Eye API version.

  2. The camera in use does not support this operation.

Solutions:

  1. Ensure the firmware version matches the software version.

  2. Verify that the camera in use supports the intended operation.

CV-E0264

Error: The input device parameter value is outside of the valid range.

Solution: Ensure the entered value is within the valid range.

CV-E0265

Error: An internal software error occurred.

Possible cause: Unknown errors occurred in Mech-MSR.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0266

Error: The image data is empty.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0267

Error: An internal software error occurred.

Possible cause: Unknown errors occurred in Mech-MSR.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0268

Error: Failed to execute the file reading or writing operations due to an internal error.

Solution: Please contact Technical Support.

CV-E0269

Error: The operation timed out.

Possible cause: The time to retrieve data or connect to the data acquisition device exceeded the set “Timeout”.

Solutions:

  • Ensure that the image data can be retrieved correctly in Mech-MSR.

  • Set an appropriate “Timeout” value.

CV-E0270

Error: An internal error occurred in the data acquisition device.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0271

Error: An internal error occurred in the data acquisition device.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0273

Error: Failed to connect to the data acquisition device due to an internal error.

Solution: Please contact Technical Support.

CV-E0274

Error: Failed to connect to the data acquisition device due to an internal error.

Solution: Please contact Technical Support.

CV-E0275

Error: An internal error occurred in the data acquisition device.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0276

Error: An internal error occurred in the data acquisition device.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0277

Error: An internal software error occurred.

Possible cause: Unknown errors occurred in Mech-MSR.

Solution: Please try restarting the camera and reconnecting. If the issue persists, please contact Technical Support.

CV-E0278

Error: Failed to connect to the data acquisition device due to an internal error.

Solution: Please contact Technical Support.

CV-E0279

The camera cannot be connected because it has been occupied.

Possible cause: The camera has already been connected with an IPC.

Solution: Before connection, please ensure that the camera has not been connected to other IPCs.

We Value Your Privacy

We use cookies to provide you with the best possible experience on our website. By continuing to use the site, you acknowledge that you agree to the use of cookies. If you decline, a single cookie will be used to ensure you're not tracked or remembered when you visit this website.

  • Preference
  • I accept
  • I don't accept