Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers
Authors: Mani Golparvar-Fard, Arsalan Heydarian, Juan Carlos Niebles
Abstract:
Video recordings of earthmoving construction operations provide understandable data that can be used for benchmarking and analyzing their performance. These recordings further support project managers to take corrective actions on performance deviations and in turn improve operational efficiency. Despite these benefits, manual stopwatch studies of previously recorded videos can be labor-intensive, may suffer from biases of the observers, and are impractical after substantial period of observations. This paper presents a new computer vision based algorithm for recognizing single actions of earthmoving construction equipment. This is particularly a challenging task as equipment can be partially occluded in site video streams and usually come in wide variety of sizes and appearances. The scale and pose of the equipment actions can also significantly vary based on the camera configurations. In the proposed method, a video is initially represented as a collection of spatio-temporal visual features by extracting space–time interest points and describing each feature with a Histogram of Oriented Gradients (HOG). The algorithm automatically learns the distributions of the spatio-temporal features and action categories using a multiclass Support Vector Machine (SVM) classifier. This strategy handles noisy feature points arisen from typical dynamic backgrounds. Given a video sequence captured from a fixed camera, the multi-class SVM classifier recognizes and localizes equipment actions. For the purpose of evaluation, a new video dataset is introduced which contains 859 sequences from excavator and truck actions. This dataset contains large variations of equipment pose and scale, and has varied backgrounds and levels of occlusion. The experimental results with average accuracies of 86.33% and 98.33% show that our supervised method outperforms previous algorithms for excavator and truck action recognition. The results hold the promise for applicability of the proposed method for construction activity analysis.
Keywords:
Computer vision
Action recognition
Construction productivity
Activity analysis
Time-studies
Operational efficiency
Published in: Advanced Engineering Informatics (Volume 27, Issue 4, January 2013)
Publisher: Elsevier
ISSN Information: 1474-0346
Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers
- Ngày hội Văn hóa đọc lần VI
- Vòng Sơ Khảo Cuộc Thi Đại Sứ Văn Hóa Đọc Năm 2024
- Ngày hội sách “CITTADELLA” khuyến khích và tôn vinh vai trò của sách trong sinh viên Bách khoa
- Cuộc Thi Ảnh “Khoảnh Khắc VNUHCM Libraries”
- Ngày hội văn hóa đọc lần V
- Ngày hội văn hóa đọc lần II
- Ngày hội văn hóa đọc lần IV
- Ngày hội văn hóa đọc lần III
- Tiếp GS Omer Mert Denizci, Trường ĐH Marmara Thổ Nhĩ Kỳ
- Tiếp Cô Claudia Tarzariol Từ The University Of Trento, Italy (Unitrento)
- Tiến sĩ kiều bào Mỹ tặng sách trị giá 150.000 USD cho sinh viên bách khoa
- Khảo sát ý kiến bạn đọc
-
Trực tuyến:14
-
Hôm nay:1795
-
Tuần này:25863
-
Tuần trước:40192
-
Tháng trước:58656
-
Tất cả:4047759