SPE Proposal - E² - Education & Experiences
Hello after a few conversations across the ecosystem, thought it was a good time to post the pre-proposal for this SPE. We have a few opportunities in Dec that would produce some short-term and impactful deliverables.
This initial proposal is focused on AI literacy, education and experiences that leverage Livepeer’s AI and livestreaming capabilities within the creative and cultural sector.
Why is this mission important?
Education is important for potential users to understand the technology and how to incorporate it into their existing processes or create new workflows. Much of the high–level offerings are out of the price range of those who could benefit from this technology the most.
Education also involves use of the network to test and design new use cases. This is not just about how many generations are made but how many generations make it to production.
Innovation - By applying market research to development we continue to refine a tool that is powered by Livepeer and shape it to fit the needs of those that are in the process of technology upskilling/adoption. We also help Livepeer see where to focus efforts based on user feedback/demand that arises out of entering new networks.
Awareness - This is is an opportunity for Livepeer to broaden its reach to other ecosystems and by powering live experiences the network and its capabilities can continue to reach new potential users as it aligns itself with examples of real-world use cases.
What tactics will you use to achieve the mission for the first 6 months?
Develop and Launch High-Quality Educational Content: Create and release digital workshops, including short-form and long-form videos, to engage and educate the creative community on using AI tools.
Host Interactive Public Events: Organize co-creation experiences, public performances, and in-person workshops to build community engagement and showcase AI-driven storytelling.
Technical Integration and Tool Refinement: Continuously integrate AI models like LoRAs and Segment Anything, and enhance application offerings which improve the user experience and solve for real-world industry problems.
Establish Strategic Partnerships: Collaborate with creatives, brands, and cultural organizations (e.g., Svensk Live) to expand outreach and integrate AI tools into broader use cases.
Pilot Programs and Market Research: Conduct pilot programs with targeted partners to test, refine, and gather insights into sub-markets in the creative and marketing sectors.
Content Production for Social Impact: Generate social media content and articles to increase visibility, reach 500k+ impressions, and which also drives awareness b
What concrete deliverables will you look to have by the end of 6 months?
Deliverables (Six Month Pilot)
Digital Educational Content 12 short-form + 6 long-form educational videos
Awareness and Reach: - 500k+ social impressions + (2-3) public experiences
Examples:
Case Study around the co-creation of dance music visuals in Amsterdam w/livestream
(Dec)
Case study around post-event co-creation at a high-profile theatrical production in
Warsaw (Dec)
Pre-production: Case study around co-creation in a spherical visualization center in
Norköopping (likely happening post this pre-proposal)
Market Research: 8 sub-markets of creative, culture, marketing sector
Network Demand: 10k+ Generations (this number will likely be higher)
Who is the team?
Core Team
Time AI 100 ✦ 2X Livepeer Grant Recipient ✦ 2x Sozu Haus Member ✦ Mantle Grant Recipient ✦ Stable Founders Program ✦ AI x Design Member ✦ AI Sweden ✦ Nordic Music Tech
Use Cases /Press - Music Tech, Music Ally, AI Sweden, The Aipreneur
Sean - Founder, ORIGIN STØRIES - co-created the first blockchain-enabled generative AI tool which saw 70k+ generations and more than 8,500 users during the prototype. B.S. Northwestern University (7.2% acceptance rate), 2x feature NY Times, 20 million + Spotify streams. Member of Stable Founders, AI Sweden. Extensive educational background including co-founding an international arts education non-profit.
Adam - Founding Engineer, ORIGIN STØRIES - BE in Computer Science. 8 years of commercial full-stack development and product design experience. Co-created B2B SaaS web-product. Won ETH Lisbon 2021 hackathon. Art enthusiast.
Will - Comedian & AI Storyteller, [Time 100 AI 2024]. Creator of the viral AI-generated “BBL Drizzy” song. A seasoned comedian and writer, with extensive credits in Hollywood and He began experimenting with AI tools in 2023 during the writers strike, and believes AI can empower underrepresented creators, allowing them to realize their ambitions without extensive resources. His work has led to collaborations with figures like Will Smith and Drake, and he plans to premiere a BBL Drizzy musical at Art Basel Miami.
Almer - Company Owner, TSG Music. The Sound Group (TSG) has become a reputable source of music-related content with a substantial YouTube following [(187k+ followers). TSG Music stands out by focusing on artist growth and helping them reach their full potential, rather than simply signing and releasing music. Almer is also member of Svensk Live, a network of clubs, festivals, non-profit organizations, amusement parks, promoters, arenas and agent companies within Sweden. They also work with over 200 youth organizations (25 and under) to help them facilitate and produce live music events.
Educational Series will be distributed via:
- Short-from content on Reels + TikTok (opportunity for Livepeer collaborator tag)
- Youtube + ORIGIN STØRIES site
- If desired on Livepeer AI site in Docs
- Distribution Partners - (list still in formation)
- Shared across our ecosystem
Materials for Workshops will live in a Public Github Repo:
- Distributed across sites such as Console.
- Selected materials will exist in AI research spaces such as AI Sweden.
Findings and research may be published if it appears valuable to a larger audiences
Budget Allocation Over (Six Month Pilot Initiative)
Requested Amount - 3,333 LPT
Development:
25% for refining tools and integration with Livepeer pipelines.
Workshops and Education:
30% for AI literacy programs, including workshop materials, instructor fees, and venue costs.
Public Performance Events:
30% for event execution and logistics, including venue rental, equipment, and marketing.
Marketing and Partnerships:
15% for outreach and expansion, including marketing campaigns, partnership negotiations, and branding materials.
Conclusion
Over the last 24+ months we have received feedback and validation from artists, builders, partners, participants and prospective clients on all 6 inhabited continents. We are confident that with the support of Livepeer we can not only continue to be at the forefront of innovation but also help others realize the opportunities that are possible with the AI infrastructure.
APPENDIX: EXTENDED PROPOSAL
SPE Pre-Proposal by ORIGIN STØRIES
AI LIteracy & Public Experiences
This proposal is focused on education and experiences, which leverage Livepeer AI technology. Key benefits include increased network demand for Livepeer AI, real-world use cases, community empowerment, and enhanced brand visibility. The proposal outlines a six-month pilot initiative with milestones for development, workshops, public events, and marketing. Our KPIs are focused on increasing network demand, educational content, and social reach. This initiative aims to bridge the gap between AI technology and creative storytelling, fostering innovation and community engagement.
Project Overview
SPE Focus Areas:
- AI Literacy: Empower creatives with the tools and knowledge to utilize and build using AI, with a focus on Livepeer AI.
- Public Experiences: Showcase AI-driven innovations by creatives and provide audiences with new, immersive experiences.
- Technical Advancements: Develop agentic workflows around curation, integration of LoRA’s, and style consistency, ensuring specialization in creative AI workflows.
Deliverabls (Six Month Pilot)
E-learning: 12 short-form + 6 long-form educational videos
Awareness and Reach: - 500k+ social impressions + (2-3) public experiences
Network Demand: 10k+ Generations
Market Research: 8 sub-markets of creative, culture, marketing sector
Benefits to the Livepeer Ecosystem
- Increased Network Demand:
- By empowering creatives to use AI tools, the project will drive more demand for Livepeer AI.
- Public performance events and workshops will showcase the capabilities of Livepeer, attracting more users.
- Real-World Use Cases:
- The project will develop and demonstrate practical applications of AI in creative industries, providing valuable use cases for Livepeer’s technology.
- Success stories from events and workshops will serve as compelling case studies for Livepeer.
- Community Empowerment:
- The AI literacy programs will upskill creatives, turning them into potential technical builders and advocates.
- By focusing on open-source principles, the project will foster a stronger, more engaged community.
- Technical Advancements:
- The development of agentic workflows and integration of LoRA’s will contribute to the technical advancement of Livepeer’s AI capabilities.
- Feedback from real-world use will help refine and improve Livepeer’s AI pipelines.
- Brand Visibility:
- High-profile events and partnerships with creatives and brands will increase Livepeer’s visibility in the creative and cultural sectors.
- Media coverage and social impressions from events will boost Livepeer’s brand recognition.
Target Models For Style Consistency:
FLUX.1 [dev] with controlnets and LoRAs
Stable Diffusion with LoRA’s (inpainting, image2image)
SDXL - Latent Consistency
Existing LivepeerAI models we will likely use or currently use:
- stabilityai/stable-diffusion-3-medium-diffusers:
- Segment-Anything-2 -facebook/sam2-hiera-large
- stabilityai/stable-diffusion-x4-upscaler:
- stabilityai/sdxl-turbo:
- SG161222/Realistic_Vision_V6.0_B1_noVAE
- stabilityai/stable-diffusion-xl-base-1.0
- stabilityai/stable-video-diffusion-img2vid-xt-1-1:
- Existing LoRAs db
Problem Statement
The saying goes “AI won’t replace you but you will be replaced by someone who uses AI.” But currently most of the creative and non-creative applications are missing the mark. Some of it has to do with the tech being early, but technology only inputs information. Sure it can contextualize it to some degree and (there is aspiration for “Human Intelligence”), but in reality - it doesn’t know how to tell really good stories.
Storytelling is a broad concept and requires not only conceptual understanding but trial and error when it comes to things like story arcs or basic technical aspects like storyboarding.
So while a market segment like advertisement and marketing will be quick to leverage AI for efficiency this doesn’t necessarily mean they will drive any type of innovation. In fact this past summer The Atlantic published not one, but[ two articles about how AI has failed to make an economic impact].
We believe this has to do with a variety of reasons, one being the fact that most creatives (professional and aspiring) have no access or opportunities to experiment, understand and build with the technology. Or there are
“workshops”, but they are priced too high for creatives to justify or afford (small reminder in the middle of this tech disruption, there is currently a cost of living crisis in almost every developed country).
A clear first use case for AI is efficiency and optimization.
When we think about productivity, we focus on traditional sectors like finance, legal, or HR. In fact there are regular workshops for these professions that charge upwards of 1,000 (USD) to teach basic AI and ML upskilling and are consistently full with a waitlist.
We rarely think about what productivity and efficiency looks like in the creative industries. But if AI can’t make the lives of working creatives (the ones on TV, in your marketing department, building the next big game, juggling 20 roles as musicians), then what are we really improving?
Furthermore, existing educational programs are focused mostly on traditional technical builders. While this is helpful to building infrastructure, when it comes to applications and innovation we continually hit the same roadblocks. Even with the aspiration of simulating human intelligence, creativity is not (and in our opinion) will never be as simple as 0’s and 1’s.
An artist and their label can be sure a song will go to number one on the charts and then flop. A movie can have a seasoned creative team, lauded actors, a yolo budget, and a flashy premiere and still completely miss the mark. These are people that know the rules and are able to break them. It’s why a film like Blair Witch Project can come out of nowhere and change cinema. In reality it’s about the nuance of the storyteller, and while this is aspirational for AI it’s coming no time soon.
Tech maxi’s will deny this but not everything can be done through data. But this is why major companies are partnering to create models trained on their existing archives, so in the short term they can sell this information as proprietary data. It is the same thing about focusing only on network demand instead of quality of output. Do we really need to flood the internet with more content just because we can?
We are at a crucial point. As Grimes said a few weeks ago on Twitter stated
“This whole AI situation is actually so terrifying - we might have to fight for control over the narrative or the planet will be controlled by 4 tech dudes forever. This is a turning point in human history and we need to all be extremely vigilant and proactive.”
No offense to those four tech dudes (who probably aren’t reading this proposal), but do we leave the creatives behind and focus on users and demand?
Or in the spirit of open source, and community empowerment do we try to build a better future? Our choice is clear and that is why we are submitting this proposal to create a Special Purpose Entity (SPE) with Livepeer.
We believe by focusing on our three main goals, we can not only help to expand demand on the network, but also build real-world use cases, while simultaneously upskilling creatives and helping to redefine public perception.
It’s not enough to use the build it and they will come mentality when it comes to the implementation of artificial intelligence into creative workflows. We often refer to the “paradox of choice” where too much choice leads to paralysis. This is why instead of trying to build grocery stores, we are focused on curated meal kits.
We are choosing to focus the initial educational and experience offerings in the digital realm, with targeted IRL programming and collaboration in Sweden (a global powerhouse across all sectors), Benelux (a leader in dance and electronic music), Australia (a leader in experiences, tech, and innovation) and the UK (no intro needed). With the success of this initial six month project we plan to expand under the scope of a new proposal.
Our programming will be offered in at least three languages - English, Swedish, and Dutch. The team will also provide monthly updates, with two larger quarterly reviews showcasing our progress.
A Brief History of ORIGIN STØRIES x Livepeer
For the last two plus years we have been laser-focused on building generative AI solutions that live up to the hype. In early 2024, thanks to a Livepeer video disruptor grant, we explored how AI video could enhance the visual experience for live music events.
The project began with R&D in Helsinki, and Amsterdam with co-created concert experiences. It continued at the Eurosonic Festival in Groningen, Netherlands, and then developed into a custom product with Livepeer and Livepeer Studio that allowed concert-goers to co-create visuals during a private live streamed event in Stockholm.
The event, held at The Node (funded in part by The Avicii Foundation), featured 27 musicians and was attended by 155 people in person and 229 via livestream, generating over 100,000 social impressions and 500+ AI-generated assets. The use case was filed in AI Sweden and also lead to activations during Cannes Lions and features in leading music publications Music Tech and Music Ally.
Post-event, we continued our development focused on increasing the speed of non-generation tasks (pre-production, prompt engineering, visual editing) and adding video models that help to provide directional control over visual outputs.
This past September we produced a unique co-creation experience for Archetypes, an electronic festival in Poland. We saw 97% guest participation, further validating the opportunities that arise in this transformative phase.
We’ve recently completed the Livepeer AI startup program where we’ve continued to refine our offerings and tech stack. We have also integrated text-to-image, and image-to-video models from Livepeer AI and begun development of additional functionalities, including LoRA’s, video-to-video, image-to-image, segment anything, and real-time-video.
As the Livepeer team in the background continues to add pipelines and improve issues like speed and cost, we aim to support its growth by providing education and new experiences available to the public. We also aim to continue to integrate pipelines and transform them into usable and scalable applications for the creative and culture sectors.
Our next development phase involves refining tools to better fit market readiness and customer needs.
Core Team
Time AI 100 ✦ 2X Livepeer Grant Recipient ✦ 2x Sozu Haus Member ✦Mantle Grant Recipient ✦ Stable Founders Program
Sean - Founder, ORIGIN STØRIES - co-created the first blockchain-enabled generative AI tool which saw 70k+ generations and more than 8,500 users during the prototype. B.S. Northwestern University (7.2% acceptance rate), 2x feature NY Times, 20 million + Spotify streams. Member of Stable Founders, AI Sweden. Extensive educational background including co-founding an international arts education non-profit.
Adam - Founding Engineer, ORIGIN STØRIES - BE in Computer Science. 8 years of commercial full-stack development and product design experience. Co-created B2B SaaS web-product. Won ETH Lisbon 2021 hackathon. Art enthusiast.
Will - Comedian & AI Storyteller, [Time 100 AI 2024]. Creator of the viral AI-generated “BBL Drizzy” song. A seasoned comedian and writer, with extensive credits in Hollywood and He began experimenting with AI tools in 2023 during the writers strike, and believes AI can empower underrepresented creators, allowing them to realize their ambitions without extensive resources. His work has led to collaborations with figures like Will Smith and Drake, and he plans to premiere a BBL Drizzy musical at Art Basel Miami.
Almer - Company Owner, TSG Music. The Sound Group (TSG) has become a reputable source of music-related content with a substantial YouTube following [(187k+ followers).] TSG Music stands out by focusing on artist growth and helping them reach their full potential, rather than simply signing and releasing music. Almer is also member of Svensk Live, a network of clubs, festivals, non-profit organizations, amusement parks, promoters, arenas and agent companies within Sweden. They also work with over 200 youth organizations (25 and under) to help them facilitate and produce live music events.
Additional Team
We will also work with specialists, freelancers, and contractors across a variety of sectors in addition to liaising with our adversarial team, which includes a 13+ year advisor for Bandcamp, active in the public sector.
Proposed Milestones (November to April)
Phase 1: Initial Development (November to December)
- Small Invite-Only IRL Workshop:
- Conduct a small, invite-only in-person workshop to gather initial feedback and refine tools.
- Strategic Planning and Script Development:
- Develop strategic plans and scripts for upcoming workshops and events.
- Reach Out for Instructors:
- Identify and reach out to potential instructors for AI literacy workshops.
- Integration of LoRAs and Other Livepeer Pipelines:
- Begin integration of LoRAs and other Livepeer pipelines based on user feedback and surveys.
- Public Experience Around Co-Creation and Holidays:
- Execute a public experience focused on co-creation and holiday themes.
- Collaborate with a luxury department store for this activation, including distribution.
- Shoot Initial Episodes for Digital Workshops:
- Produce initial episodes for digital workshops to be released in January.
Phase 2: Early Adoption (January to February)
- Release First Episodes of Digital Workshops:
- Launch the first episodes of digital workshops
.
- Launch the first episodes of digital workshops
- Continue Social Impact through Video Shorts and Written Articles:
- Create and distribute social impact content through short videos and written articles.
- Continue Development and Integration:
- Continue refining tools and integrating Livepeer pipelines based on feedback and industry advancements.
- Execute Public Performance Events:
- Organize and execute public performance events integrating real-time AI visuals.
- Scale Adoption to Multiple Live Events:
- Expand AI-driven experiences to multiple live events.
- Test New Functionalities:
- Implement and test new functionalities based on user feedback and industry trends.
Phase 3: Market Expansion (March to April)
- Further Technical Integrations:
- Continue integrating technical advancements based on industry innovations and improvements.
- Strategic Pilot Program with Svensk Live:
- Initiate a strategic pilot program with Svensk Live and potentially local projects.
- IRL Workshop Frameworks:
- Develop frameworks for in-person workshops that can be expanded to other locations.
- Secure Partnerships with Creatives and Brands:
- Establish partnerships with creatives and brands to expand the reach of AI-powered content creation tools.
- Expand AI-Powered Content Creation Tools:
- Broaden the availability of AI-powered content creation tools to wider audiences.
- Evaluate and Iterate:
- Evaluate the success of the pilot programs and workshops, and iterate on the strategies and tools based on feedback.
Educational Series will be distributed via:
- Short-from content on Reels + TikTok (opportunity for Livepeer collaborator tag)
- Youtube + ORIGIN STØRIES site
- If desired on Livepeer AI site in Docs
- Distribution Partners - (list still in formation)
- Shared across our ecosystem
Materials for Workshops will live in a Public Github Repo:
- Distributed across sites such as Console.
- Selected materials will exist in AI research spaces such as AI Sweden.
Findings and research may be published if it appears valuable to a larger audiences
Budget Allocation Over (Six Month Pilot Initiative)
Requested Amount - 3,333 LPT
Development:
25% for refining tools and integration with Livepeer pipelines.
Workshops and Education:
30% for AI literacy programs, including workshop materials, instructor fees, and venue costs.
Public Performance Events:
30% for event execution and logistics, including venue rental, equipment, and marketing.
Marketing and Partnerships:
15% for outreach and expansion, including marketing campaigns, partnership negotiations, and branding materials.
KPI’s (Six Month Pilot)
E-learning: 12 short-form + 6 long-form educational videos
Awareness and Reach: - 500k+ social impressions + (2-3) public experiences
Network Demand: 10k+ Generations
Market Research: 8 sub-markets of creative, culture, marketing sector
Conclusion
Over the last 24+ months we have received feedback and validation from artists, builders, partners, participants and prospective clients on all 6 inhabited continents. We are confident that with the support of Livepeer we can not only continue to be at the forefront of innovation but also help others realize the opportunities that are possible with the AI infrastructure.
/✗] Technical Integration Progress
