How do I use Milestone XProtect with Wasabi using Lucidlink?

Wasabi is certified for use with Milestone XProtect Video Management Software.   More info on this joint solution can be found here.  The XProtect application does not natively support an S3 object storage interface for connection to a S3-compatible service like Wasabi. In order to use Wasabi with Milestone, you will need to use a third party application like Lucidlink to convert Milestone's file system interface to S3 object storage interface.  

Requirements

  • Milestone XProtect Management 2019 version R2
  • LucidLink application and an active subscription
  • Wasabi cloud storage account

Reference Architecture

mceclip1.png

Please Note: The data restoration process is handled by your specific backup software application. As there are many potential variables that will affect your unique environment, it is strongly recommended that you seek the guidance of your backup software's technical support team in the event that you encounter difficulty, or have application-specific inquiries.

Configuration

  1. LucidLink 
  2. Milestone XProtect

 

  • LucidLink Configuration

To Install LucidLink application - following information available here

1. Login in to your LucidLink webportal account

mceclip0.png

2. Once logged in, click on "Create a new Filespace"

mceclip1.png

3. If you already have a Wasabi account choose "Bring your own storage", if you don't have a Wasabi storage account, you can sign up for Wasabi storage via LucidLink or directly via Wasabi. If you choose to sign up via LucidLink, click on "Use LucidLink Storage"

mceclip2.png

4. Provide a name for your Filespace and click "Next"

mceclip11.png

5. Choose Wasabi as your cloud storage provider (Note: in step 3, I chose "Bring your own storage")

mceclip4.png

6. Choose Wasabi region and click "Next"

Note that this config example discusses the use of Wasabi's eu-central-1 storage region. To use other Wasabi storage regions, please use the appropriate Wasabi service URL as described in this article 

mceclip14.png

7. Review and confirm the configuration choices and click "Create"

8. Once the Filespace has been created, click "Initialize"

mceclip17.png

9. In order to Initialize the Filespace, the LucidLink client application needs to be installed and operational, click "Launch the desktop client"

mceclip8.png

10. Once the LucidLink application launches, input your Wasabi S3 keyset

Note : review following article to access Access & Secret keys via Wasabi console 

mceclip21.png

11. Once you input the S3 keyset, set LucidLink's root account password and click "Initialize"

mceclip26.png

12. Once initialization completes, LucidLink will create a local copy of your filespace metadata (the file index), whilst the data itself will reside in Wasabi Cloud Storage. Once complete, click "Open the folder", At this point all of the videos to edit and/or alter can be moved or migrated to this folder on your workstation via a drag and drop or other file copy operations.

mceclip11.png

13. Your LucidLink Filespace namespace will appear as a shared drive on your workstation as shown below.

mceclip29.png

14. The 'test' LucidLink namespace points to Wasabi storage account bucket name "milestonelucidlink" All of the data stored on "test" will physically live on Wasabi cloud storage as objects. These objects aggregate upto all the assets stored on "LUCID (L:)" share.

screenshot4.jpg

 

  • Milestone XProtect Management 2019

The Milestone XProtect should be installed and configured with the video surveillance cameras that are setup to be 'recording'.

mceclip5.png

The rules within the Milestone application are configured to “start recording immediately on all cameras”. This triggers the Milestone application to record all the camera output (irrespective of motion sensed) and write it to storage.

mceclip10.png

In the Storage settings (shown below), the live Recordings are written to a local storage (C:\) for a short duration of 2 hours after which the videos are then archived over to Wasabi's cloud storage via the LucidLink shared drive (L:\).

screenshot5.jpg

 

Use Cases

Retention

XProtect Corporate manages the transfer from multiple recording server's live databases to Wasabi using LucidLink, as well as the number of days of retention for the archived data. LucidLink copies the archive database using S3 protocol to Wasabi. Wasabi's bucket retention policies can then be enforced to purge the data based on the set retention time.

Retrieval and Playback

LucidLink's distributed file service allows users to view the video within the XProtect Smart Client. LucidLink is a distributed file system that splits the data and the metadata layers allowing simultaneous user access. It streams, prefetches data and offers caching support. 

 

Troubleshooting

To troubleshoot any performance or connectivity related issues with your Wasabi - LucidLink filespace you will need to know the following: 

  • Your Wasabi Account ID or email address associated with your Wasabi account
  • Your Wasabi Bucket name
  • The Wasabi region in which your bucket is located.

If you are using the Basic LucidLink filespace and have signed up for a Wasabi account through LucidLink, you may not be aware of the above details. You can retrieve the Wasabi bucket and region information using the “lucid status” command.

To get this information, follow these steps:

Open a command prompt window or Terminal from your machine connected to the LucidLink filespace and run the command “lucid status”.

support.png

The command provides the information about the filespace including the details about the Cloud storage provider, bucket name, region, and endpoint URL.

C:\Users\wasabi>lucid status
Client state: Linked
Filespace object store state: connected
Filespace object store download latency: low
Filespace object store upload latency: low
Filespace service state: connected
Filespace file index: up-to-date
Filespace name: partner-engg.wasabilucidlink
Filespace id: ffa6f0c3-21bc-448b-8b4d-606c867ebf25
Filespace block size: 256KiB
Filespace encryption mode: full encryption
Filespace bucket name: lucidlink-files
Filespace compression: lz4
Filespace maximum file size: 512TiB
Filespace object store bucket name: lucidlink-files
Filespace object store protocol: https
Filespace object store provider: Wasabi
Filespace object store type: s3
Filespace object store region: us-east-1
Filespace object store endpoint: s3.wasabisys.com
Filespace object store virtual addressing: off
Filespace object store location constraint: on
Filespace mode: live
Filespace version: 3
Root directory: C:\Users\wasabi\.lucid\
Mount point: L:
Root point:

 

Now that you know this information, you can check to see if you can reach that region and bucket. There is a Knowledge Base Article to help with this I am not seeing the network performance I'm expecting - what should I do?

Essentially, you’ll want to make sure you can reach the appropriate endpoint URL by using the ping or traceroute commands.  (For region-specific URLs, please refer to What are the service URLs for Wasabi's different storage regions?)

You may also want to run a Speed Test between your local system and the edge of the Wasabi Region. Instructions on this area are in the KB article above, or you may go directly to http://wasabi.speedtestcustom.com/  (Please contact Wasabi Support for the password). 

If you are still unable to resolve your issues and there are no specific error logs that the Lucid Link team has identified,  please have the following information ready when you reach out to Wasabi support - 

  • Account ID or email address associated with your Wasabi account
  • Bucket name
  • Wasabi region in which your bucket is located.
Have more questions? Submit a request