Ask HN: How to automate activity annotation for mouse videos?

2 points

9 years ago

I have some mouse videos from top view chamber.I also have an excel sheet with start time and end time of each activity. I need to automate behavior recognition.I did some digging and found that this comes under video classification .I can use model such as only CNN(checking every frame) or combination of CNN + RNN etc.

I saw popular datasets like UCF 101 and it has separate labeled video clips of each activity. But in my case I have multiple mouse activity in single video. So do I need to cut one video for each activity of mouse(base d on time) then label them and then train the model ? Also which framework is best suited for this - Keras ,OpenCV etc ?

Only related coding example I found was this - https://hackernoon.com/five-video-classification-methods-implemented-in-keras-and-tensorflow-99cad29cc0b5