Back to Research
2024-02-10HackathonGenAIVideo MLBenny Award

AI Shorts & The Creator Economy: YHack Victory

Winner of 1st Place and the prestigious Benny Award at the 2024 BYU ACM YHack Hackathon.

AI Shorts

AI Shorts & The Creator Economy: YHack Victory

At the 2024 BYU ACM YHack, we set out to bridge the gap between long-form content and the viral potential of short-form video. In just 21 hours, we built a production-ready microservices architecture for automated video curation.

The Mission

"Build something that helps architect, enhance, or protect the Creator Community."

Key Innovations

  • Engaging Section Detection: We developed an algorithm to identify the most engaging parts of a long video to automatically crop into 3 high-impact shorts.
  • Automated Metadata: Using AI-generated transcripts, we suggested titles, descriptions, and hashtags tailored for TikTok and YouTube Shorts.
  • Cross-Platform Analytics: A comparison engine that tracks trends across YouTube, TikTok, and Twitch to suggest content strategies for creators.

System Workflow

Shorts GeneratorVision/Audio MLAI OrchestratorCreatorShorts GeneratorVision/Audio MLAI OrchestratorCreatorUpload Long VideoSpeech-to-Text & Visual CuesEngagement MetadataCrop & Format for Verticals3x Viral Shorts + Captions

Results

Our team's execution from concept to completion earned us First Place and the Benny Award. A huge thank you to BENlabs for sponsoring and providing technical mentorship throughout the night.

Leading a team of brilliant engineers (Jonghyuk Lee, Suhyun Baik, Minjoong Kim, and Taehoon Kim) was the highlight of the event.