Classifying Cutting Volume at Shale Shakers in Real-Time Via Video Streaming Using Deep-Learning Techniques
- Xunsheng Du (University of Houston) | Yuchen Jin (University of Houston) | Xuqing Wu (University of Houston) | Yu Liu (Shell) | Xianping (Sean) Wu (Shell) | Omar Awan (Shell) | Joey Roth (Shell) | Kwee Choong See (Shell) | Nicolas Tognini (Shell) | Jiefu Chen (University of Houston) | Zhu Han (University of Houston)
- Document ID
- Society of Petroleum Engineers
- SPE Drilling & Completion
- Publication Date
- September 2020
- Document Type
- Journal Paper
- 317 - 328
- 2020.Society of Petroleum Engineers
- video processing, real-time monitoring, drilling optimization, machine learning
- 43 in the last 30 days
- 181 since 2007
- Show more detail
- View rights & permissions
|SPE Member Price:||USD 5.00|
|SPE Non-Member Price:||USD 35.00|
A real-time deep-learning model is proposed to classify the volume of cuttings from a shale shaker on an offshore drilling rig by analyzing the real-time monitoring video stream. Compared with the traditional video-analytics method, which is time-consuming, the proposed model is able to implement a real-time classification and achieve remarkable accuracy. Our approach is composed of three modules: a multithread engine for decoding/encoding real-time video stream. The video streaming is provided by a modularized service named Rig-Site Virtual Presence, which enables aggregating, storing, transrating/transcoding, streaming, and visualization of video data from the rig; an automatic region-of-interest (ROI) selector. A deep-learning-based object-detection approach is implemented to help the classification model find the region containing the cutting flow; and a convolutional-neural-network-based classification model, which is pretrained with videos collected from previous drilling operations. Normalization and principal-component analyses (PCAs) are conducted before every video frame is fed into the classification model. The classification model classifies each frame into four labels (Extra Heavy, Heavy, Light, and None) in real time. The overall workflow has been tested on a video stream directed from an offshore drilling rig. The video stream has a bitrate of 137 Kbps, approximately 6 frames/sec (fps), and a frame size of 720 × 486. The training process is conducted on an Nvidia GeForce 1070 graphics processing unit (GPU). The testing process (classification inference) runs with only an i5-8500 central processing unit (CPU). Because of the multithreads processing and proper adaptation on the classification model, we are able to handle the entire workflow in real time. This allows us to receive a real-time video stream and display the classification results with encoded frames on the user-side screen at the same time. We use the confusion matrix as the metric to evaluate the performance of our model. Compared with results manually labeled by engineers, our model can achieve highly accurate results in real time without dropping frames.
|File Size||15 MB||Number of Pages||12|
Arora, R., Basu, A., Mianjy, P. et al. 2016. Understanding Deep Neural Networks with Rectified Linear Units. arXiv:1611.01491 [cs.LG].
Dahl, J., Morgan, C. J., Gillen, M. E. et al. 2017. In-Situ Downhole Cuttings Analysis. US Patent No. 20150114714.
Dhanachandra, N., Manglem, K., and Chanu, Y. J. 2015. Image Segmentation Using K-Means Clustering Algorithm and Subtractive Clustering Algorithm. Procedia Comput Sci 54: 764–771. https://doi.org/10.1016/j.procs.2015.06.090.
Du, P., Samat, A., Waske, B. et al. 2015. Random Forest and Rotation Forest for Fully Polarized SAR Image Classification Using Polarimetric and Spatial Features. ISPRS J Photogramm Remote Sens 105: 38–53. https://doi.org/10.1016/j.isprsjprs.2015.03.002.
Goodfellow, I., Bengio, Y., Courville, A. et al. 2016. Deep Learning, Vol. 1. Cambridge, England, UK: MIT Press.
Graves, W. A. and Rowe, M. D. 2014. Down Hole Cuttings Analysis. US Patent No. US20140333754A1.
Guilherme, I. R., Marana, A. N., Papa, J. P. et al. 2011. Petroleum Well Drilling Monitoring through Cutting Image Analysis and Artificial Intelligence Techniques. Eng Appl Artif Intell 24 (1): 201–207. https://doi.org/10.1016/j.engappai.2010.04.002.
Ioffe, S. and Szegedy, C. 2015. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Paper presented at the 32nd International Conference on Machine Learning, Lille, France, 6–11 July.
Krizhevsky, A., Sutskever, I., and Hinton, G. E. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Adv Neural Inf Process Sys 25 (2): 1097–1105. https://doi.org/10.1145/3065386.
Lecun, Y., Bengio, Y., and Hinton, G. 2015. Deep Learning. Nature 521 (7553): 436–444. https://doi.org/10.1038/nature14539.
Marana, A. N., Chiachia, G., Guilherme, I. R. et al. 2009. An Intelligent System for Petroleum Well Drilling Cutting Analysis. Paper presented at the International Conference on Adaptive and Intelligent Systems, Klagenfurt, Austria, 17 November. https://doi.org/10.1109/ICAIS.2009.16.
McNutt, M. K., Camilli, R., Crone, T. J. et al. 2012. Review of Flow Rate Estimates of the Deepwater Horizon Oil Spill. Proc Natl Acad Sci USA 109 (50): 20260–20267. https://doi.org/10.1073/pnas.1112139108.
Parmeshwar, V., Orban, J., Arefi, B. B. et al. 2017. Shale Shaker Imaging System. US Patent No. 20170161885.
Ren, S., He, K., Girshick, R. et al. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (June): 1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031.
Routray, S., Ray, A. K., and Mishra, C. 2017. Analysis of Various Image Feature Extraction Methods Against Noisy Image: SIFT, SURF and HOG. Paper presented at the Second International Conference on Electrical, Computer and Communication Technologies (ICECCT), Coimbatore, Tamil Nadu, India, 22–24 February. https://doi.org/10.1109/ICECCT.2017.8117846.
Simonyan, K. and Zisserman, A. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:1409.1556 [cs.CV].
Torrione, P. A. 2017. System and Method for Estimating Cutting Volumes on Shale Shakers. US Patent No. US20170058620A1.
Ulyanov, D., Vedaldi, A., and Lempitsky, V. 2016. Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv:1607.08022 [cs.CV].
Wauthier, F. L.-F. 2013. Learning from Subsampled Data: Active and Randomized Strategies. PhD dissertation, UC Berkeley, Berkeley, California, USA.
Yang, L., Yang, S., Jin, P. et al. 2013. Semi-Supervised Hyperspectral Image Classification Using Spatio-Spectral Laplacian Support Vector Machine. IEEE Geosci Remote Sens Lett 11 (3): 651–655. https://doi.org/10.1109/LGRS.2013.2273792.