Horse detection and gait classification become more important when the online horse com- petitions will expand. To support the jury in reducing the manual process machine learning might be a good solution. This paper focuses on the horse detection and gait classifica- tion. The best results base on a combination of two convolutional neural networks, the EfficientDet D0 for object detection and the Inceptionv3 for gait classification.