Invisible lost time (ILT) has been estimated to contribute significantly to well construction costs. Reduction of drilling connection time can lead to significant savings, especially in offshore drilling projects. The overall time of a drilling connection can easily be measured using conventional sensors on the rig. However, to gain further insight into the source of operational inefficiencies it is beneficial to breakdown the overall drilling connection process into smaller sub-processes and quantify the time spent doing each. Current sensor technology does not allow us to easily measure these sub-processes on the rig. In this paper, we outline a deep learning-based computer vision method to analyze and measure such sub-processes within the overall drilling connection process using a real-time video feed.
Video of the drilling connections is streamed in real-time using a novel IT framework. In a proof of concept exercise, we applied image recognition techniques to enable us to breakdown and classify the sub-processes during the drilling connections. Convolutional neural networks (CNNs) - a deep learning algorithm - are used to analyze these video images frame by frame to identify rig activities.
The workflow includes an analytics pipeline to capture video on the rig, transfer of data to the office, video recognition analysis, tabulation of results, and delivery of this result to a graphical interface for cognitive analytics. We performed experiments wherein CNNs were used on the video images to diagnose rig activities with good accuracy. Incorporating the temporal information using a recurrent network has been shown to further improve analysis accuracy.
The described workflow is a suggested method for automating the detection of inefficiencies on drilling rigs using rig floor video and machine learning. For the demonstration case, we successfully analyzed video captured on an offshore rig and derived high value useful information using machine learning. This video analysis information can be further combined with conventional drilling sensor data to boost accuracy to identify and confirm rig activities and to quantify invisible lost time during each connection. The presented techniques demonstrate the potential of video analytics as a reliable, low-cost means to effectively "micro-analyze" various rig operations with the aim to identify and replicate best composite performance.