VideoNet is a new initiative to bring together the community of researchers that have put effort into creating benchmarks for video tasks. Our goal is to bring together video benchmarks, exchange ideas on how to improve annotations, evaluation measures, and learn from each other's experiences. Cameras are around us everywhere, generating millions of frames of video footage every day. Why limit yourself to a single image when you can have a video?