top of page

Major Project

Initial Research Question:

What can home videos and the practice of collecting, watching, editing, and scoring them with samples reveal about the self and the culture it comes from?

          The performance served as an embodied sample of the digital audiovisual practice, intended to convey its playful and improvisatory nature with the space and the technologies provided. In this instance, it was the EMS 7.1.4 Room that played host. The first half of the performance featured a 16-minute video of clips from the eighteen works, highlighting the nine different audiovisual techniques, and their examples cited in the exegesis. During the video’s projection, I played with the idea of showing the audience only what I wanted them to see - only a sample of the full practice. Such manipulation suggested a lineage of selective documentation and presentation that continues all the way up through this writing. In my original viewing of the home movies, I saw and heard only what my parents (mostly my father) had chosen to film. Now, the audience sees and hears only what I have chosen to reveal. I have wondered what a revelation might uncover about myself and the culture I come from. 

​

          The second half of the performance provided a look into the creative and self-exploratory compulsion that inspired the techniques, attempting to translate the practice into physical form. Through many steps, I played around with my audiovisual techniques, and sampled the attempted destruction of a home movie tape. While the past cannot be destroyed, it can be re-worked, re-played, and re-sampled. Although methodised, the practice and its performance are intended to change with each representation. The eighteen audiovisual works have been completed, but the practice carries on, transforming itself across media and presenting itself through me. The process is ongoing. 

01 - Fantasy Island
06:21

01 - Fantasy Island

00:00:00:08 - 00:00:32:21 Unknown Check one to. So right now I am taking a piece of footage from Fantasy Island and watching myself exiting a ride and running around the corner, yelling, screaming ecstatically. I want to do that again. Right. 00:00:35:01 - 00:01:19:23 Unknown I want to go on that again. And Dad saying, you like that. And so what I'm doing is I'm just using my mouse to scroll through the footage frame by frame and capturing the audio of me. So breaking myself. I want to go on that again and breaking that down frame by frame and capturing the sound and just playing with moving the cursor, the play head back and forth to hear the little bits of sound that are coming from for me. 00:01:22:10 - 00:02:11:04 Unknown So I'm also trying to figure out how to best record the bits of me scrolling through the video with the play head. So I've tried with the the road microphone just from the speakers, from my monitors, and then I've tried my test came from the monitors as well. And I was doing that through quick time, but that could just be done through Ableton because it's the same thing. 00:02:11:04 - 00:03:12:02 Unknown I'm just recording what is coming through the the, the monitors. Now I'm going to try to freeze frame some of these still images in Premiere and see what happens with that. I need to learn more about the frame hold capacity in Premiere, but I think there's something there. So for this I guess project this day, five beats a day I am working on moving the play head back and forth and breaking the bits up, the audio bits up and sampling those and seeing where that goes. 00:03:13:21 - 00:03:53:11 Unknown So I'm thinking about just editing the audio first and playing with the audio without seeing the video and just manipulating that and playing around with that before adding any video. So disconnecting, disconnecting the audio from the video and treating that before reconnecting them. So I'm just continuing the beat, the drums and the bass and then finding different vocal bits that I like. 00:03:53:18 - 00:04:33:23 Unknown Of my siblings screaming or getting really excited and using those as rhythmic and little melodic. Adding samples from Splice like percussion samples, kind of goofy stuff. Just testing out, adding some other things, thinking about just like continuous beats, continuous beat tape. How do I change the tempo and using breaks from splice but potentially finding like a break bank? 00:04:34:11 - 00:05:13:01 Unknown And then I like or that mean something you know, they're a library of breaks that is more significant than other. Or does it not matter? I'm thinking about adding lyrics, a little rap spoken words related to what's going on in the video, but not on screen. So the things that are happening in the home video, but what I didn't select those that got deleted. 00:05:14:10 - 00:06:37:23 Unknown Also thinking about instrumentation and how it would be performed. So just drums and bass could be nice. And then maybe like Monty's guitar and potentially or keys and or sample pad. Thinking about honoring my dad's camera work and his I, his time spent with the camera, his relationship with the camera. So I am recording the like me moving the play head and premiere and then putting them in the simpler and Ableton and playing the sample back and octave lower and then freezing and flattening that track and and then using the sample again in the same. 00:06:38:00 - 00:07:15:16 Unknown And the simpler too, to make a beat. So I and looping the video and the audio and playing around with a loop, a video loop which looks nice on the Ferris wheel and yeah, piano chords that fit the mood. Maybe, and thinking about scoring and Yeah. And also I need to maybe take an audio bit from the first film. 00:07:16:23 - 00:08:08:24 Unknown I'm currently editing the videos, so I'm adding the videos into Ableton and trying to edit them in Ableton, which doesn't give me a whole lot of control, but it does let me stretch them in a fun way and am talking into the side of the camera with microphone. Um, what else I can. I did a bunch of frame holes in premiere that I'm exporting and then bringing in Ableton, which gives a bit of randomness to like the singing because like, I'm not going in and perfectly singing them to the music.
02 - Jumping in Leaves
06:17

02 - Jumping in Leaves

00:00:00:14 - 00:00:50:04 me So working with the kids, jumping in leaves video, which is about 6 minutes long and I think I'm going to just make some beats that last 6 minutes, maybe not play with the video or edit the video at all. Just let it run and maybe think about choosing one of these functions, functions of music and film and watching myself at three years old jump into a relatively big pile of leaves and dive into it headfirst and yelling along the way. 00:00:50:04 - 00:01:59:19 me And it makes me laugh, makes me smile. Watching such joy in mischievousness or telling my step mom to build up the pile bigger and then clenching my jaw and running as fast as I can, coming up and smiling, sometimes staying in the pile and disappearing into it. So the steps of scoring at this moment and in the process be to watch the video without the sound and indeterminate tempo and to noodle around on the piano, the mini keyboard, and find some notes or some chords that resonate with what I'm seeing. 00:02:00:24 - 00:02:51:12 me And I'm interested in creating like little themes. Maybe in this case for each kid that jumps, jumps in or to to do the, the relational thing where I'm the main theme and then they are the rest of the kids at the harmonics and overtones. I am also thinking about just choosing a key and working with that key as a way to learn the key on the piano scales. 00:02:51:12 - 00:08:04:01 me So after choosing some notes that I like and a tempo that I like and I'm making a drum beat with the 808 pack and just filling in that beat that's in my head, I'm going to make two separate beats.
03 - Table Dancing
02:46

03 - Table Dancing

00:00:00:10 - 00:00:19:08 me Starting day three and feeling a bit tired, starting about an hour late and but good to just go and do something. 00:00:21:21 - 00:00:48:01 me It's day three thinking about blog like an end of the World blog. It's day three and all I have is music making apparat. I am so I can do is make music and mix it with video. 00:00:51:12 - 00:01:28:23 me Yeah. So if I'm going to use one of Jerry Levinson's film music and narrative agency and one of his 15 functions of music and film, looking at number nine, which is the suggesting to the viewer of how they are to regard or feel about some aspect of the story. For example, compassionately. So I think we can play around with that. 00:01:30:02 - 00:02:17:09 me So what I'm doing or what I did was I started with U2's walk on, which is what's playing in the video. And so I downloaded two versions of that song, the original or the album version, and then also a more recent version about Ukraine. And I took samples from those two tracks and like piano, guitar and a little like drum thing and put those together, chop them up, put those together, and then what did I do after that? 00:02:17:09 - 00:02:51:00 me I think I added some bass guitar and some more drums, a two way drums, and then a drum break and the vocal samples and a couple of vocal samples from the original video of me and my dad saying something. So those those are coming from the video. And now I'm going to, I think, look at the lyrics of Walk On and maybe try to rap them or say them or something. 00:02:51:00 - 00:03:19:18 me Um, we'll see. So for this one, for the visuals, I was using the for the audio samples, the video track, like the audio visual track, and I was putting it below the original video track. So it was overwriting the video. So every time a sample plays, that piece of video also plays every time an audio sample plays that piece of video sample plays. 00:03:20:12 - 00:08:04:01 me So it keeps going back to that to that audio visual sample. 00:00:39:05 - 00:01:28:06 vocals To keep us up to snuff has a long way to go to class. Hard cracks. Then you turn. The darkness has to keep us up to snuff. Has a long way to glass hard cracks. Then you turn the bar was not easy to unlock and those knocking steadily. And I can that many good kids and I can no longer stay in my larger than life. 00:01:28:19 - 00:02:21:20 vocals And you can no longer line his hands. And then I am my mind is not what it is on the line. You smile and say so, but I know my oh, oh, oh, oh, oh, oh, oh, oh, oh. Call oh, oh, oh, oh, oh, oh, oh, oh, oh, oh, oh. I don't know what it is, but I am in a long time I can say where I ran and long term the lot on the very small parts of the song. 00:02:21:21 - 00:08:06:03 vocals But I know long.
04 - Nova Scotia
05:06

04 - Nova Scotia

00:00:01:09 - 00:00:41:11 me So what I'm doing is I've got four different clips from the Nova Scotia tapes and I'm going to make a beat for each. So try and make four beats before lunchtime and yeah, I'm going to pick a tempo based on just the audio. So not even looking at the video, just the audio from the videos and pick a tempo and stick with the tempo throughout. 00:00:43:01 - 00:08:07:01 me So step one is selecting that the four videos that I trimmed from the like the hour long video. And step two is to pick a tempo for the first video based on the first video using just the audio and the pace of my dad's questioning. Step three is to and right a little theme on the piano for the scene that can be looped. 00:00:00:01 - 00:00:17:02 audio samples We are well with our very. Wow. Yes. Just doing right. Yes. Yes. These things going right now. We are. Wow. 00:00:20:01 - 00:00:43:15 audio samples Very. Wow. Yes. Just doing right. Yes. Yes. These things going right now. We are just doing right. Yes, yes, yes. Just doing right now. Just doing right. Yes. Yes, yes. Just doing right. Yes. Yes. Just doing right. Yes, yes, yes, yes, yes, yes, yes. Doing right. Yes, yes. These things going right now. We are just doing right. Yes, yes, yes, yes. 00:00:43:15 - 00:01:20:02 audio samples Doing right now. Doing right. Yes, yes, yes. Just doing right. Yes, Yes. You're doing right. Yes, yes, yes. Just doing like wow. Yes, yes. Just doing right. Yes, yes. These things going right now. We are. Wow. Living together very well. Yes. Just doing right. Yes. Yes. These things going right now. Are we are. Wow. Very wow. Yes. Just doing right. 00:01:20:07 - 00:01:47:13 audio samples Yes. Yes. These things going right now where we are. Wow. With our marriage. Wow. Yes. Just doing right. Yes. Yes. These things going right now. We are just doing right. Yes, yes, yes. Just doing right. Well, just doing right. Yes, yes, yes, yes. Doing right. Yes, yes. Just doing right. Yes, yes, yes, yes, yes, yes. Just doing right. 00:01:47:17 - 00:02:14:07 audio samples Yes, yes. These things going right now. We are just doing right. Yes, yes, yes. Just doing right now. Just doing right. Yes, yes, yes, yes. Doing right. Marriage. Yes. Yes. Just doing right. Yes, yes, yes, yes. Dealing right now. Yes, yes. Yes. Doing right. Yes, yes. These things going right now. We are. Wow. Living together very well. Yes. 00:02:14:07 - 00:04:10:19 audio samples Just doing right. Yes. Yes. These things going right now. We are. Wow. Living together very wow. Yes. Just doing right. Yes. Yes. These things going right now. We are. Wow. Living together very well. Yes. Just doing right. Yes. Yes. These things going right now. Hi, I'm Nancy Welch, coming from NBC News from Nova Scotia, Canada. Today, we are talking about how family really matters to everyone and hey, you can see, you know, we can see you and and you. 00:04:10:19 - 00:04:46:00 audio samples We can see you. So we can see you and well, I must admit, that has been something of a culture shock, as Stephen called it, to have six people from a city come and visit me in a very quiet setting. And their lifestyle is so different from my lifestyle. Your lifestyle so different than my lifestyle that it's really hard, a bit hard to see you adjust to. 00:04:46:00 - 00:08:08:06 audio samples However, it has been a delightful experience having you all here in one place, and I would hope that you come back again. Okay, I well, thank you. And that's all the time we have have.
05 - Piano Recital
04:38

05 - Piano Recital

00:00:02:00 - 00:00:32:15 commentary Some notes before beginning some reflections that I wrote down last night. Faster beat making choose the scoring technique, either melody, timbre or rhythm or story. What's the story? Write it out and score it. Using what instruments? How to communicate with music. How music can change the meaning of a scene, and how the story can be different for the same video depending on the music. 00:00:34:08 - 00:01:03:18 commentary What questions am I asking? How am I connecting with the inner child? What does this practice reveal about the home video? Or what does the practice of scoring reveal about the home video? And what does the home video reveal about the practice of scoring and how can I show the materiality of the videos or the manipulation of them? 00:01:05:01 - 00:01:43:03 commentary So what I like to do here is use the same scene, this piano recital scene, and and add different music on top of it for a variety of feelings and to change how the scene feels depending depending on the music. So first I'm going to start by writing a little story about the scene and then go from there. 00:01:44:00 - 00:02:15:05 commentary So story one, the boy doesn't want to be there. He's nervous, he's scared, he's having trouble breathing, and his piano teacher is strict. He doesn't feel very comfortable around her. She shows little love on the inside. She expects a lot and doesn't like mistakes. He's excited when his sister joins him. It feels better to have a companion. He doesn't know the people watching him. 00:02:16:11 - 00:02:43:05 commentary There are so many grown ups. The room is so big and cold. It's sad and sorry. The room is so big and cold. It's sad because his feelings of music become tied to feelings of anxiety. So now I'm going to watch the video back and play around on the piano to find the mood, the mood from the story. 00:02:44:12 - 00:03:37:01 commentary I'm also keeping in mind Jo Levinson's functions of music and film. Number one, the indicating, the indicating or revealing of something about a character's psychological condition, including emotional states, personality traits or specific cognitions, as when the hero has just realized who the murderer was. So I what I did was pick a minor key, and it's. Yeah, just started a little thing on the piano and the three different piano tracks and then added some of like the toms from the 88 track. 00:03:37:20 - 00:04:09:24 commentary And then when my teacher came into the frame, I sort of changed key, went down step to the key of G Sharp and and kind of changed the tone to communicate like a bit more anxiety and discomfort. And then that ends when our performance ends, my sister comes on the stage and we have a new sort of feeling with bass. 00:04:11:14 - 00:04:59:04 commentary So I took a screenshot of me working in Ableton toward the end of the music section and, and overlaying that screen recording on top of the original video and kind of cutting it at random and implanting it and kind of it disrupting the natural. Yeah, recording original video, thinking about scoring, using only samples. Perhaps for tomorrow I'm going to try to leave the commentary in, in the track randomly throughout and see how that sounds or works. 00:04:59:24 - 00:08:07:01 commentary So some reflections, maybe make it simpler. Just a few notes. Just really looking at the relationship between notes and intervals and how they effect emotion.
06 - House Demolition
02:54

06 - House Demolition

00:00:01:11 - 00:00:41:07 commentary So today I'm going to try scoring by sampling. So using samples only and to score and perhaps follow one of the functions of music and film. So thus far I have split up or cut down the original home video into two different segments. One is my dad going around the old house and showing the graffiti that us kids wrote on the walls. 00:00:42:03 - 00:01:27:20 commentary And then the second is the house being demolished from the outside. I have also pulled in four different tracks for my iTunes from 2000 for when this all took place and currently just overlaying them on top of the videos to see what kind of feel it gives and kind of is like temp tracks. So within the Still Tippin track by Mike Jones, they use a sample from the South German Philharmonic Orchestra, and Alfred Schulz called William Tell Overture. 00:01:28:13 - 00:02:04:17 commentary So I'm going to take that string sample and work with that. So I made a three or four drum beat just because I like the pacing set, the tempo while watching the the first video of my dad touring the house. And I'm going to add the violin. So I tried like making a three or four drum beat and using some song samples, but I couldn't really do much just trying to add in some drum breaks. 00:02:04:17 - 00:02:53:07 commentary But it was unsuccessful, converting them to three four time. So now I am moving on to the demolition scene and I was pitching down, slowing down still. Tippin And then sampling all falls down from corner and slowing down the video. So what I did is I pitched down still. Tippin and all falls down and then sped up the video by a few half steps and and yeah, I'm interested in this sort of opposition of slowed down and sped up. 00:02:53:07 - 00:08:07:01 commentary Usually the video is slowed down and the vocal remains the same speed or music remains the same speed here. The audio slowed down in the video is sped up and it's a curious effect.
07 - New Bikes
06:42

07 - New Bikes

00:00:00:16 - 00:00:29:24 commentary So what I've done thus far as a screen recorded this selection of videos of me going through the hard drive and choosing a video to work with. What I like to do is show the same sequence on a loop, but change the music. So maybe change the tone or the key or something like that. The instrumentation or something. 00:00:31:12 - 00:01:03:04 commentary First, I'm going to put some temp music on top of this loop and see what that does to the feeling. I'm then pick songs from my iTunes library from the same year 2001. I'm interested in this idea of breaking down scoring too, like it's core elements and just a few notes. So I'm going to put some temp music on top and then and go back and perhaps just do drums and piano. 00:01:04:12 - 00:02:05:19 commentary I'm remembering that I'm also a deejay. Maybe I'll put all of the temp tracks on top of the looped video and see which one works best and then go from there. I'm also going to start with the looped video silent or maybe with the original audio. So what I did was I put the temp music on top of the same visual loop, and then I also put some other vocal stuff like clip from the Tour de France and a little piano melody, like horse racing thing and a synth drone rising in pitch and also in modulation as well as on top of that, a clip from the sound of the video camera rising in pitch 00:02:05:19 - 00:02:50:07 commentary as well. And and then the drum beat starts that I made. So what I did at the end was I gathered the screen recordings of the selection process. When I choose a video to work with and I cut them up and put them together before the sequence starts. So it's like a little intro sequence showing the selection process and scrolling through all the different videos I have on the hard drive. 00:02:51:02 - 00:08:08:13 commentary One overarching question I have at this point is what is scoring?
08 - Mr. Saxophone
04:14

08 - Mr. Saxophone

00:00:00:19 - 00:00:49:15 commentary So the plan for today is to work with the saxophone video of me practicing the sex saxophone with Mr. Brachita and this concept, and that I am drawing from a therapy session this morning, which is the saxophone as my friend, as an old friend, and going to see where that goes. Also, I'm thinking about including the song that I started on about Mr. Brachita, my saxophone teacher, and expressing thanks to him and writing him a letter of appreciation and gratitude in the form of a song. 00:00:50:12 - 00:01:28:16 commentary I'm also thinking to use the footage of me wrestling and in some way, especially the bits where I'm like waiting and in anticipation and feeling very nervous, that leading up to the event segment is interesting. I'm going to convert the audio from the saxophone video into MIDI. See what happens with that. So when you convert an audio track to Mini, you slice it by melody or harmony. 00:01:28:17 - 00:02:01:21 commentary When you slice it by melody, it also tracks into mini vocal sounds. So it creates different pitches for talking. So going to work with that as well. So I transcribed the notes from the original video and audio of this. Me playing the saxophone and then changed the tempo and made it into a baseline. And now I'm building a drum beat from that and going to add in and out. 00:02:02:10 - 00:02:40:01 commentary Alto sax sample. I like this idea of only showing like little bits and choosing what you see and but making that happen in real time, moving things in and out of the screen, recording. So the length of the track, the different loops is just determined by the length of the screen recording that I took, which is about 4 minutes long. 00:02:40:07 - 00:08:07:23 commentary I'm also interested in this concept of trying to find a piece of the video that I like searching for and not finding and going back and trying to find it. The part where I'm crowned the winner of the match and trying to get back to that point, but not being able to.
09 - Ice Skating
04:24

09 - Ice Skating

00:00:01:00 - 00:00:56:20 commentary So I've chosen the video of us ice skating and up in upstate New York, and I was playing around with screen recording the selection process, but also the filming. So bringing and just pieces of the video into the frame of the screen recording so that you can only see little bits, little square bits of the original video. So I'm going to play around with different chords and on the piano to see how they affect the video in different ways. 00:00:57:00 - 00:01:50:19 commentary And I'm working from the book Music Theory for Dummies, and and I think I'm going to pick a single scale or multiple scales, and I'm not sure yet. First, I'm going to choose a tempo based on the rhythm of the video, so I'm going to tap out the time to choose some drum loops now that I have a tempo, some drum loops, and then going to work with some taking drum sample loops from the B Lab sample pack folder that I have and just warping them and trying to fix them to the grid, which creates kind of a nice uneven rhythm because it's not all fixed perfectly to the grid and they use the skate 00:01:50:19 - 00:02:20:10 commentary sounds as part of the beat. So I make a little drum rack with the skate sounds. So I've picked different drum breaks, loops and for each loop I'm playing a different chord within the G scale. And so starting with G major, then G minor and G augmented. G diminished. G major. Seven G minor. Seven G dominant. Seven G minor. 00:02:20:10 - 00:08:07:23 commentary Seven flat five G diminished. Seven in G minor Major seven. So I'm going to go through all of those and create little like arpeggiated rhythms with the notes in each of those chords, and then for each different drum loop and chord structure, I'm also creating a new bassline.
10 - Big Shirt Christmas
06:07

10 - Big Shirt Christmas

00:00:00:23 - 00:00:41:19 commentary So today I'm thinking about working with the freeze frame or the frame hold and potentially composing an entire video of just frame holes and doing that in Premiere and musically thinking about the musical or sonic equivalent of a frame hold freeze frame. So in the original home video, uh, my sister Olivia is singing maybe from Annie the movie. 00:00:42:20 - 00:01:22:20 commentary So I'm, I found I downloaded a couple versions of that song from the Motion picture soundtrack and from the Broadway soundtrack, and I'm going to use it as a sample to make a beat and see where that goes. I'm also going to screen record part of my screen and to show what I'm doing when I'm making this beat and I'm going to hold off on working with the video. 00:01:23:04 - 00:02:04:11 commentary I'm just going to use the make the audio, make a track potentially using some audio samples from the original video. But I'm not going to work yet with the video. It's actually my sister Dylan, who is singing maybe in the original home video, not Olivia. So I'm trying to record some lyrics, just like little poems, raps that I wrote, but also a transcription of the poem about Dad's medicine read aloud in this video on Christmas Eve. 00:02:04:13 - 00:02:16:14 commentary Christmas Eve. I might try to just take that sample of her reading the poem and make it a rap and try to play with it. So that sounds like a wrap. 00:02:18:21 - 00:02:55:12 commentary So after I made the song and composed it into different sections like two, two main sections that are different have different energies that then sort of come together at the very end after making all of the musical bits and the audio. I then went in and edited the video within Ableton, so I kept the original video mostly intact, especially at the beginning. 00:02:57:00 - 00:03:47:19 commentary But then toward the end I started cutting in certain video bits at like on the downbeat so that there is more thinking between the audio and the visual. I also included in the musical elements part of the audio from the original video. So occasionally the audio from the original video will appear or will sound within the song and those bits sync up the most in terms of you're hearing what you're watching on the screen. 00:03:48:18 - 00:04:27:03 commentary So after I did all of that editing in Ableton, so editing both audio and visual stuff in Ableton, I exported the video and the soundtrack and brought it into Premiere Pro, where I wanted to combine it with a screen recording that I took of me making this track in Ableton, which includes going into Spotify and iTunes and downloading music and going on the Internet. 00:04:27:03 - 00:05:04:14 commentary So I wanted to include that screen recording somehow. So it's about 2 hours worth of a screen recording of me of the process of making this whole thing. So what I did is I brought that screen recording in to premiere and place it on top of the original video that's been edited and just based on formatting the screen recording showed up as a smaller square on top of the larger square of the home video. 00:05:05:05 - 00:05:38:01 commentary And I like that look. And then I started to just cut the screen recording at different bits where I wanted the home video to show through without the overlay of the screen recording. I also condensed the screen recordings down to the length of the home video. Edit So from 2 hours down to say, five and a half minutes, 6 minutes. 00:05:38:17 - 00:06:19:16 commentary So it's sped up and it's showing that process over a compacted amount of time. In doing this, I was playing with this idea of the process or the method sort of getting in the way of the final product. So it's obscure bringing the final product in. And in ways here it's obvious because you have the actual box of the screen recording that's obscuring the finished product, the finished video edit. 00:06:19:24 - 00:06:58:14 commentary So playing around with that idea, the process getting in the way in the process, kind of ruining the effect, the immersion of watching the final video, edit you can't quite get into it. And then the on and off of the screen recording, showing over the the home video. So sometimes it's there and sometimes it's not. And sometimes I let you see the full video and sometimes you can only see the edges. 00:06:59:00 - 00:07:49:18 commentary And so there's this this blocking effect that I find happens a lot with memory where you remember only certain bits. You can only visualize certain elements of a place, but not the whole picture. So you only have part of the frame, which is in itself part of the full picture, if you will. While watching it back after I finished making it, I was thinking about the discussion with Annika ah, to our last tutorial in which we talked about the themes of American capitalism and going beyond that materialism. 00:07:49:18 - 00:08:35:23 commentary And I think this video touches upon that because it's of Christmas. So we're, you know, excited to open gifts that Santa supposedly brought to us. Um, there's one piece where Maddison is showing off a watch. I think it's a like a g-shock or a baby G watch that she had received for Christmas. So there's this presentation of, of gifts, of things, of material, things that seem to bring us happiness. 00:08:36:19 - 00:09:49:01 commentary Um, and that, that theme of that sort of Americanness, I think, comes through, uh, especially in this project. I was also thinking about the connection between the film and the story of Annie the Orphan, and this video which features my sister Dylan singing songs from that movie and the music itself features a few samples from the track, maybe from the movie and the Broadway play and there's this kind of weird connection, or almost like Paradox of us seemingly happy kids and a happy family with parents, albeit, you know, both divorced parents and step parents. 00:09:50:05 - 00:10:41:16 commentary The connection between that and Annie as an orphan and and singing about the song maybe is Annie singing about her parents maybe coming back for her and she's wondering what they're doing, what they're into. She's imagining their life and imagining why they would have left her in an orphanage. So there's this eerie to use and of course, term relevance of being an orphan, but also having two parents and two sets of parents at that. 00:10:42:06 - 00:11:39:20 commentary So a whole extra family that an orphan would have. I like the play between this happy sounding song and this happy looking scene of Christmas and dancing and vacation holiday. Between that and the sadness of the song, maybe there's there's a tension there that is maybe exists below the surface. And the last few lines of maybe from Annie are so maybe now this prayer is the last one of its kind. 00:11:40:05 - 00:12:29:19 commentary Won't you please come get your baby and the orphans are singing? Maybe. And so there's this plea and this wish and this hope. And of the lyrics of the song that are mixed in with the home video scene that has a different feel to it. But there's somehow there's a connection there and somehow there's this feeling of that children have of, you know, being alone and wondering where their parents are when they're not together. 00:12:31:05 - 00:13:16:14 commentary And there's this this longing that I think becomes a part of this project. And I think the last shot of my stepsister, Dylan, kind of staring off into the distance while my sister Maddison reads a poem about hearts, is a good distillation of those feelings, and also the camerawork from my stepmom of like the slow pulling away and the slow zooming away to kind of and and wrap up this this video. 00:13:16:14 - 00:14:04:01 commentary And one last thing. The the lyric that I sing that I bring into the track is me sort of half singing, half speaking, half rapping. Santa slips his fat ass down the slim chimney with a bag of blank that the parents worked for. So in that, I think what I was trying to express are what came through while making this song is, you know, this illusion of Santa that we at that age still believed in. 00:14:05:07 - 00:14:48:12 commentary And and the, you know, the recognition that all these gifts were coming from our parents who worked to earn the money to buy them and always gave us so many presence at Christmas. And there's this also this imagining of Santa trying to come down such a slim chimney, which feels so ridiculous as an adult, yet so plausible as a child. 00:14:50:07 - 00:15:23:05 commentary So I think what I was playing with with those lyrics is kind of this yeah, the maybe the illusion of Christmas of Santa, but also that the imagination of children behind all of that is sort of the hard work of parents to maintain the illusion and to afford the gifts and yeah.
12 - Painting Pumpkins
01:14

12 - Painting Pumpkins

00:00:00:12 - 00:00:52:23 commentary Today, I'm going to work with the Halloween 1996 home video. I am thinking about the archive, the home video as an archive of memory and moments. And what are other archives potential archives from this project. So I'm thinking about classic drum breaks that hip hop samples and an archive of voices of my family members and myself. I'm starting to make drum racks with different samples of the voices of the members of my family. 00:00:54:20 - 00:01:34:05 commentary I'm also going to try to make an instrument rack using a variety of samples of my voice to start with. Perhaps I can create a a single instrument rack with all of our different voices and create this collective voice. To hear what that sounds like. So what I did for this sequence was I sliced the original audio from the video to to Midea. 00:01:34:16 - 00:02:16:06 commentary So I sliced the melody to Midea and that created a long midea sequence sequence of notes. I then inserted onto that a few different instruments, three different instruments, a piano, a flute and a trumpet. And I had them, each instrument triggered by different notes. So low notes by the piano. High notes by the flute. And in the middle. 00:02:16:08 - 00:02:17:02 commentary The trumpet. 00:02:19:09 - 00:02:36:01 commentary So the three instruments are playing the same sequence, but are triggered at different points. I also sliced the original audio to a drum track and then inserted a high hat and a kick drum. 00:02:39:02 - 00:03:16:02 commentary So the instruments and the music are following the original audio from the video. So they're playing along to the original audio. And this becomes apparent at certain points of synchronization when we can hear the original audio come through and follow the pitch of the instruments and the rhythm of the high hat and kick drum and exploring what scoring is. 00:03:16:20 - 00:15:20:06 commentary I'm thinking about this direct translation of, let's say, diegetic sound audio from the scene. Translating that into music in the most direct way I can think of at the moment, which is converting it into notes, converting the original audio into notes, and then playing those notes, having instruments, play those notes. So the score and the musical score is a computation from Ableton, a translation of the original audio.
13 - Basketball Bouncing
03:34

13 - Basketball Bouncing

00:00:00:15 - 00:00:39:18 commentary Today, I'm going to keep adding to the vocal drum ranks and taking slices, vocal slices, and adding them to the drum rocks I started making yesterday. As part of this archival process and I'm thinking for myself, I want to collect all these samples of me speaking and then feed them into a text to speech algorithm so that I can create my own artificially intelligent voice. 00:00:40:16 - 00:01:22:22 commentary Because this home video was made in 1997, I'm going to go through my iTunes library and pick out some tracks that I can sample and make a few beats. Also, using samples from the home video, I'm becoming aware that it's hard to take clean samples of the voices if there's lots of background noise. So in this case, in a auditorium, sports hall with bouncing basketballs and people shouting, it's almost not worth it to take the vocals samples from my family members. 00:01:23:13 - 00:02:02:05 commentary I think I'm going to wait until a cleaner video comes, until I work with the cleaner video where it's easier to take, extract and exploit audio samples. I'm going to make a kick drum out of multiple samples of the. I also added some samples, some Foley samples because I wanted to create the impression that sounds were coming from the video even when they're not. 00:02:03:24 - 00:03:04:06 commentary So I added some sounds of kids playing some samples of sticks breaking, which sounds like a candy wrapper opening. I use some samples of basketballs bouncing and also downloaded a sample of commentator or commentating during an NBA Finals game in 1997 between the Bulls and the Jazz. So that comes in at different parts. I was noticing how the addition of string lines, like a cello string, makes the video feel more nostalgic and so when watching the video and hearing the strings, there's this nostalgia that's created by the cello string. 00:03:04:08 - 00:15:21:11 commentary And I'm curious if that's just my perception or if that would be the perception of a listener. So I'm going to send the song and the video to a friend and see what they say. I'm learning not to use too many samples in one individual track because it feels like too much is going on. There's not enough focus on one sample.
14 - Kids Breakfast
04:40

14 - Kids Breakfast

00:00:00:22 - 00:00:45:18 commentary Today I'm going to play around with using a still image to score. Thinking about this idea of can a still image be scored in the same way that a moving image can? What happens to a still image in a freeze frame when music is put on top of it? First, I'm going to go through the original video from 1996 and find the bits that I can add to the drum racks that I've started to make. 00:00:46:00 - 00:01:24:12 commentary One thing I'm doing is collecting whenever someone says my name. So I'm taking those samples and putting them into a drum rack. So I'm playing around with taking a stills from the video and using the mouse zoom function to move the frame around the image. I'm exploring the image, zooming in and out with a song from my iTunes on top of it. 00:01:24:22 - 00:01:46:16 commentary The first song I used is called Collage of Dreams by John Beltran, which was part of the Fabric Presents Bonobo album from 1996. 00:01:50:01 - 00:02:23:24 commentary I'm going to bring that screen recording of me moving around the image and bring that into Ableton and put a few different songs on top of it to see what the different effects are. Thinking about this idea of making in an image move. Making a still from the video move in some way and adding movement to a still. 00:02:25:17 - 00:02:54:11 commentary And then on top of that, what happens when that movement is sent to music, preexisting music, In this case? And what's the difference when the music is mine, when I make it versus using a preexisting song? In this case, I'm using spontaneity by Bahamadia. 00:02:56:18 - 00:03:53:07 commentary Is it more significant when I make the music? I also was playing around with soloing the original audio from the original video soloing that at certain points throughout the track. So kind of cutting into the Bahamadia track, kind of injecting the original audio into more on top of the spontaneity track, kind of like a deejay does one playing one record and then cutting in at certain times... 00:03:53:07 - 00:15:19:16 commentary Another record.
15 - Hot Tub
03:32

15 - Hot Tub

00:00:00:21 - 00:00:50:15 commentary So for this project, I started with the image and video. So it was the hot tub sequence of my sister Madison asking to see the video camera. So I started with that clip and I was trying to manipulate the video in a way, so I wanted to corrupt it. Modulated by removing some of its code. So I was trying to find a way to efface the video by removing its code. 00:00:51:18 - 00:01:30:09 commentary So I tried a few different programs that would convert the video into coded language and then delete lines of code. But that didn't work. I didn't know how to re encoded or to translate it back to a video. So what I ended up doing is a process of data matching and finding a software called a video Vitamix that would allow me to delete certain frames from the video to delete certain what's called iframes. 00:01:31:11 - 00:01:54:01 commentary So I deleted iframes from the video and that gave me the resulting data matching glitch effect where it skips frames and loses information, which creates a pixelated glitchy effect. 00:01:56:04 - 00:02:40:23 commentary So I did that. And then after that, I was just playing around with like a midea drum pad that my housemate Tiernan had in his room. He let me borrow. It's playing around with that. And making a drumbeat and playing the piano on the pads of the mini drum pad. And I was playing around with that and created a little tune and started developing that tune and then wanted to combine the data matching project of the hot tub sequence with this little piano. 00:02:41:15 - 00:03:31:16 commentary And in a way, a drum rack tune. So for the audio, I was using a two way drum rack and just a a built in piano and instrument plug in with an Ableton. And it's developing song and added some 88 bass. And I also used the drum racks I've been creating with the voices of myself and my family of seven or eight different drum racks with the voices of my family, my sisters, my dad, my stepmom and myself. 00:03:32:01 - 00:04:10:08 commentary And for those drum racks I just translated, I use the same MIDI sequences from the piano tracks and applied those to the drum racks of the voices. So they're playing the same sequence of notes or rhythm that the piano did. Different piano tracks or playing. I'm also using the the glitched or data matched audio from the hot tub sequence video. 00:04:11:07 - 00:04:50:21 commentary And so when I data matched the sequence, it created this glitch effect for the video for the visual, but it also created this glitch and echo effect for the audio. So that comes in periodically throughout the this song as well after making the audio. So making this track the song I was playing around with how to to show the video or how to this to match the audio in the video. 00:04:51:02 - 00:05:34:11 commentary And originally I had the data matched video and on a loop such as this the thing going through and then looping back to the beginning. But I wanted to play around more with this idea of scoring an image and putting music on top of a still image and exploring this idea of can you make an image move with music when it's still so how can a still image be made to move with music? 00:05:34:17 - 00:06:07:09 commentary And also using frame holds. So I took the the data matched video and put it into Premiere Pro, and then I added a frame hold for the image that we see in this final cut and extended that frame hold for a few minutes and then exported that from Premiere and brought it back into Ableton and had that frame hold as a video. 00:06:08:05 - 00:06:47:00 commentary So it's not just one, it's an image, it's a frame hold. So it's a video, a video file that's in Ableton. And you can see slight movements because of the frame hall effect and premiere, that there's a slight movement to this still image, this otherwise still image, this image slash frame hold. Video file is a product of the data mashing so it has this glitched and appearance to it. 00:06:48:03 - 00:07:27:22 commentary And I wanted to explore this glitched image with music that includes all of these glitched sounds from the voices, all these fragments of voices from my family, which become clear at the very end of the track when all the other music fades away and we're left just with the drum racks of the voices. I wanted to overlay that on top of this glitched image and try to create movement that way. 00:07:29:00 - 00:08:09:18 commentary And the end of the final cut also reveals the full video sequence. So we we finally see where the the still the glitched, still image comes from. And we get more perspective or more of a view of where this fragment came from. So I guess the main questions that I'm asking or was asking and am still asking are can you score a still image? 00:08:10:10 - 00:15:21:03 commentary What happens when you score a still image? And what difference does it make if that image is data smashed?
16 - Boy with a Video Camera
04:06

16 - Boy with a Video Camera

00:00:00:18 - 00:00:38:16 commentary Today, I'm going to work with the video of me holding the video camera. I'm so showing my perspective or how I used a video camera. In this video clip, there is a shot of the sheet music for this, the song Rubber Ducky. So I think when they try to to recreate that or to play out that that song on the piano and use that as the base for the music. 00:00:39:16 - 00:01:18:18 commentary So what I've done thus far is recreate the melody and harmony of one of the sections from the Rubber Ducky song and added some bass, created a few different drum patterns with two different kits. And then I also went through the audio of the original video and pulled out samples from different members of my family and added, added those to the drum racks that I've been creating and adding to. 00:01:19:11 - 00:02:01:21 commentary And now I'm going to put all the pieces together and try to make a song. And then afterward, play with the video. So once I made the music and put the music together into different sections, I then edited the video to match or sync with the music, and I was working with a specific length of video because it was the video where I'm holding the video camera. 00:02:02:12 - 00:02:31:14 commentary So I just cut up those bits, loop them, spliced them together and to react to the music. And I purposely didn't show the full clip of the sheet music for Rubber Ducky until the very end, because I didn't want to give that away so easily throughout the song. 00:02:34:16 - 00:03:14:08 commentary One cool thing rewatching these videos, or in this case watching it for the first time and editing it, is realizing that the things that I was filming when I was six years old are the same things that I'm filming today. For example, filming along the wire or cable across the the hardwood floor and following that cable with the camera along the floor is something that I still do today. 00:03:14:11 - 00:15:21:11 commentary So without even realizing it, I have these more static tendencies. When I pick up a video camera.
17 - Two Thousand
05:09

17 - Two Thousand

00:00:01:01 - 00:00:43:21 commentary So what I'm doing is now putting music to the video I made. The video is a around five minute video mashup of the year 2000. So it all comes from one digitized videotape. And I went through that and found the moments that I myself am in frame and took out those moments and put them all together and then standardized the length of each clip to around 10 seconds. 00:00:44:10 - 00:01:29:01 commentary And by doing that, the and the rate of the frame and the rate of the sound changed with the duration. So some of the clips are sped up and some of the clips are slowed down to fit the ten second duration period that I gave to each clip. So to make the music, I'm going to sample a Gypsy Kings song and which is playing in one of the scenes of the original home video. 00:01:30:01 - 00:02:00:21 commentary The song is called Pedir Corazon, and I'm dancing to this song in the original video. So I'm going to sample that. And for the drums, I just shuffled through my iTunes library and to find a track by Purple Disco Machine. I'm going to slow it down to 90 bpm terms and make a drum beat out of it and then see where that goes. 00:02:02:15 - 00:02:48:22 commentary So I used a variety of samples or bits from this Gypsy Kings song and say, I went through and took out a few different bits of it that I liked and used those. We pitched them to a different key and put them in the sampler in Ableton and put around, played around with those. And I used the purple disco machine drums and this the drums from the track Dramatic. 00:02:49:20 - 00:03:38:15 commentary And I also used the boom bap kit, drum kit and Able Tin to create a separate drum beat, a couple of different beats that are mixed in throughout. I didn't do any thinking of music and video, and I just started the audio where the video started. So first I made the video and then I made the audio and chose the tempo at 90 bpm and then didn't do any further sinking. 00:03:38:15 - 00:04:22:21 commentary So all the sink points are coincidental. One thing I struggled with was extending the music to the full length of the video, so the roughly five and a half minutes of video that I was working with, I was trying to fill that duration with music. And because I was working with just a couple of different phrases and beats and I was struggling to create enough variety and to extend the piece of music all the way throughout the video. 00:04:24:00 - 00:05:05:06 commentary So the way I managed this was just adding things and removing things every 816 bars to create some movement, some build up, And but I think it would have been perhaps easier to create two different, almost two different tracks within this. And so to have had two separate musical ideas and then join them to get one thing I'm thinking about is the idea of the process as the product. 00:05:07:01 - 00:15:18:18 commentary So the process of making this music and that being the product and thinking about ways to to show that and and one way of doing that musically is to build up a song layer by layer, as I do when I'm making the tracks, is starting with one, one or two things and then building on top of those and adding layers and showing that in the composition, the final composition.

          This project began with the archive - over thirty hours of my family’s home video footage, shot between 1996 and 2010, that my father digitised and then left alone on a hard-drive. My first step into the archive was to collect the “scenes” that I was a part of. A narcissistic endeavour indeed, I was excessively interested in my own image. I wished to single out myself and my actions, either individually or in relation to the rest of my family. And so I trimmed out scenes that I was excluded from, such as my sisters’ concert recitals and theatre performances. Once I had a collection of self-populated scenes, I sifted through them over the course of several weeks, each day picking out different scenes to work with, or “play with," a term I use throughout to suggest the playful and experimental nature of the practice. 

​

          For each scene or collection of scenes, I made an audiovisual work. In the end, the project became a practice and I had eighteen distinct works. In some, I edited the music for the video. In others, I edited the video to the music. And in others, I did both. For every work, I separated the original audio from the video, sometimes weaving them back together. The separation allowed for many moments of audiovisual “mismatch” (Wollen, 2002), imbuing the practice with a sense of tension, or yearning - parts longing to be made whole again. In all of the works, I recorded vocal commentary of my process, sometimes including the commentary in the final audio track. Throughout the practice of making eighteen individual audiovisual works, I identified nine audiovisual techniques that were applied and employed throughout. 

click on the PDF below to read more of the project's exegesis (~6000 words)

bottom of page