“Alexa, tell me how to make chilaquiles.”
This was one of the conversational commands University of Southern California journalism students programmed when creating a new skill for the Amazon Echo device that uses Alexa voice-powered technology. Chilaquiles is a Mexican dish made with corn tortillas and chili sauce, but this story wasn’t just about a recipe.
The students, Cristina Galvan and Almond Li, were working on a project for the “Advanced Journalism for Mobile and Emerging Platforms” class at USC Annenberg that promotes experimentation with a variety of emerging technology—including mixed reality, augmented reality, chat bots, stories for Alexa, 360 photo and video storytelling, and other new formats that allow journalists to tell stories in different ways.
Cristina and Almond wanted to create stories about food and culture for their semester-long class project. As the professor of the course, I talked with the students about the focus of the story, their goals and their audience. The students put themselves in the place of their users and thought Amazon Echo would be an interesting device to experiment with based on the audience experience they wanted to create.
Ingredients for Compelling Stories
Beyond a recipe skill, the students wanted to program Alexa to tell a story that a user could experience in his or her kitchen, a common place Alexa-powered devices might be used. In addition to the ingredients and cooking directions, the students built in stories from a Mexican mom who shared what the dish meant to her and how her personal memories affected the preparation of the dish.
These weren’t just the ingredients of a flavorful dish, it was a recipe for a compelling audio story and rich experience for the user. The students had to make adjustments. They had previously worked on audio and video for the web and social media platforms.
Tips from Amazon’s day-long workshop in Los Angeles on April 11 featuring tips for creating new skills for Alexa. Photo by Laura Davis
“Initially when I was editing the audio I did it as a regular audio piece, but when I started developing it, we looked at it and knew it had to be in real time as if you are in the kitchen with the person,” Galvan said. “It had to be in real time, conversational, fun and something you want to do, not feeling like ‘I’m going to cook with this robot.’ It had to be something that really made you feel like you’re bonding with the person you are listening to.”
The students recorded interviews and blended in natural sound and music for a real-time experience. They wrote a script with narration, interviews, natural sound and user actions with time code. As they developed various parts of the story, the students had to consider how long it would take to cut tortillas, make sauce and cook ingredients.
“A lot of things were really trial and error,” Li said. “The first time we did this we didn’t plan ahead enough. We thought it was going to be easy and that we were just going to [feature] the steps. Then we would insert the story in between the lines, but it was not that easy. We needed to weave things together.”
Once the students had their audio story complete and were satisfied with user experience, we focused on the technical aspects of creating a skill, or command, for Alexa. In preparation for this, I attended (and invited the students to attend) a free day-long workshop on developing Alexa skills in Los Angeles and I also examined a variety of Alexa skills.
I already had an Amazon developer account required to make skills for Alexa, but I also needed to sign up for an Amazon Web Service account. After reviewing the steps for creating an Alexa skill and going through them at the workshop, I had a good understanding of the process. (Side note: I had previous experience developing apps and some coding experience, which really helped).
I went over the process with the students on how to create the Alexa skill and also sent them a guide to get started. But even as the project was being finalized, Alexa developments, including a new interface, continued.
Submitting the Skill
We submitted the skill and it came back with a few bugs, which we are currently fixing, but you can listen to the students’ story on SoundCloud for now.
“There was a lot of help and guidelines, but one of the hardest thing is that it hasn’t been done as much before so there wasn’t a lot of videos and tutorials,” Galvan said. Even with some challenges, it was really fun to work with the students as they created a story for Alexa.
A Learning Process
- Put story first. The students wanted to create stories on food and culture. They had a simple, but strong concept of the story and what they wanted to accomplish. They considered Alexa because they thought it would be the best way to engage their audience considering the topics and goals they wanted to pursue.
- Focus on your audience and user experience. The students had to create content for a real-time experience, so they had to move away from the tight storytelling they were used to for radio storytelling, broadcast and social media content. They even went through and visualized cooking the dish themselves to take into consideration time needed for prep, dicing, cooking, etc. They worked with a script, but adapted the format for the Alexa experience. They also went beyond a recipe and told the story behind the dish and humanized the story with personal interviews and anecdotes. “For different topics you want to make sure you get a wide variety of sounds to make the story more interesting and rich,” Li said. “For us, making food and the sounds really makes the whole story richer and also so much more engaging when you hear the oils sizzling and the stove and the fire and all that. It really makes people more engaged and feel like they are in that environment. And if they are cooking, they can feel it and follow along.”
- Use existing resources and take advantage of Amazon’s step by step guidelines. Amazon has snippets of code on GitHub and also has a lot of documentation on how to get started with creating Alexa skills. We were fortunate to have access to an Amazon Echo, courtesy of the Annenberg Media newsroom. It helps to have a programming background, but it is not required to build a skill for Alexa.
- It’s okay to try and get stuck, but don’t give up. Our first skill submission had to be debugged, but we learned a lot along the way. It helps to use the device yourself regularly, stay up to date with stories about the industry, and stay current with latest tech advancements from Amazon (or Google and developments about Google Home). The students also documented their experiences on Medium and were candid about the challenges and process.
- Start simple and consider your deadline. The students completed the Alexa assignment as part of their semester-long project. “Definitely finding something that is the right amount of time and that is feasible was helpful,” Galvan said. “Starting small and also really having a good plan going into it is important. We had all semester to plan it out and think about it and that really helped.”
Professional Feedback
The project helped the students develop an innovative and flexible mindset when it comes to creating stories for emerging platforms and we are looking forward to experimenting more with Alexa and other voice-powered devices next year, in addition to other forms of emerging technology. At the end of the semester, the students got to present their projects to members of Facebook’s product development team for feedback on the last day of class.
Advanced journalism for mobile/emerging platforms class @USCAnnenberg featured AR, bots & more student projects + @facebook guests #ascj 👏🏼 pic.twitter.com/12Jryg9xcO
— Amara Aguilar (@amara_media) April 27, 2017
“I think it was really cool and interesting to just get to explore these new platforms. For myself, I was just used to doing video and text and it was really an interesting experience learning how to do something for an emerging platform,” Galvan said.
We’ve already requested a Google Home device and more Echo devices for the next school year and will also explore how controlling lights and other devices in the home can enhance storytelling.
So for now, “Alexa, get ready for more stories.”
Amara Aguilar is an associate professor of professional practice in digital journalism at the University of Southern California Annenberg School of Communication and Journalism. She teaches courses in mobile and emerging platforms, social media, design, digital news project development, among other areas. She loves journalism, Star Wars and all things tech.
