HitPaw VikPea

  • AI upscaling your video with only one click
  • Solution for low res videos, increase video resolution up to 8K
  • Provide best noise reduction for videos to get rid of unclarity
  • Exclusive designed AI for perfection of anime and human face videos
HitPaw Online learning center

Here’s How Runway AI Video to Video Works Now!

Unless you've been living under a rock, you've probably heard about Runway's new in-context model, Aleph. It is now the tool to use for the Runway AI Video to Video feature, and this article will help you see if it truly delivers a new way to edit, transform, and generate content. Let's jump right in.

Create Now!

Part 1. Can Runway Do Video to Video?

When you open the Runway dashboard, you won't see any video-to-video generation feature. There isn't a dedicated button or tool that says that anymore.

In the past, though, this feature did exist in the Gen 3 Alpha and Gen 3 Turbo models. Back then, you could upload a video and have it generate a new version of that video, up to 20 seconds long, and it would typically cost around 10 credits.

However, those models are now obsolete. Runway has moved forward with Gen 4 and Gen 4.5, and the old direct video-to-video option is no longer available in the same way.

That said, there is a workaround.

You can use Gen-4 Aleph to achieve a similar result. This tool is located under the Apps section, inside the Edit Video option. When you enter that workspace, this is the Runway AI Video to Video generation feature. It allows you to upload a video and modify or regenerate it based on detailed prompts. You can also upload reference images to guide the transformation.

There's another workaround as well. You can use Chat mode inside Runway. In Chat mode, you can upload your video and write a clear, detailed prompt explaining how you want it changed, and the AI then processes the request and generates a new version accordingly.

Part 2. How to Use Runway AI Video to Video: Runway Aleph

Here is how you can use Runway Video to Video generation with the Gen-4 Aleph model.

Step 1. Access Runway AI Video to Video Aleph Model

So first things first, you want to use Runway Aleph AI. You need to open Runway, and before you start clicking random stuff, look at the left side menu. You'll see a section called Apps. That's where everything lives. Click on Apps. Now, once you're inside that section, scroll down a bit until you find Create Video. On top of that area, you'll see a "See More" option. Click it.

Create Video option in Runway

This is where it expands and shows you the different tools available for video creation and editing. Among those options, you're looking for the one called Edit Video. That's the one you select.

Accessing Runway AI Video to Video

Step 2. Upload Your Video

Once you click Edit Video, that's basically you starting a new session inside Runway Aleph for video editing. Now you're officially in the right workspace and ready to upload your video and begin.

Now that you're inside the Edit Video workspace, you can click Select to upload a video.

Uploading a video to Runway AI Video to Video

You can either choose a file that's saved on your device or select one that you've already created inside Runway. Both options work the same way once the clip is inside the editor.

But here's the important part you really need to remember.

It doesn't matter how long your original video is. Even if it's 20 seconds, 40 seconds, or a full minute, Aleph will only use the first five seconds of that clip for editing. That's the portion it processes.

Also, the maximum video upload file size is 64MB.

So before you upload anything, make sure the first five seconds are exactly what you want to modify. If the good part of your footage starts later, you'll need to trim it beforehand and then upload the trimmed version.

Step 3. Prompting

Alright, now this is where things actually get interesting in Runway AI Video to Video.

Once your clip is uploaded, you're not just stuck with one basic edit option. You've got choices. You can type a direct prompt telling Aleph what you want to change, reshoot, replace, or modify in the video. But the thing is, your wording matters a lot. You need to be specific and intentional. If you're vague, the result will probably feel vague too.

You're not limited to text either. You can upload a reference image along with your clip. That image helps guide the look or direction of the edit. Then you write a prompt explaining what you want the tool to do using that reference. This is especially helpful if you're trying to influence colors, lighting, mood, or overall styling.

Writing a prompt to regenerate the video

There's also a built-in Aleph prompting guide available right in that section.

Accessing the Runway AI prompt guide

That guide walks you through recommended prompting styles and explains what kinds of input images work best. It gives you a clearer idea of how to shape your instructions depending on the result you're aiming for.

Next to this section, you'll see example use cases. There's even an "Add VFX to Shorts" guide showing real prompt inputs and the outputs they generate. You can also explore examples for changing seasons or weather, controlling motion, generating new camera angles, predicting next shots, rewriting footage, replacing or removing subjects, aging or de-aging people, recoloring objects, stylizing scenes, or removing backgrounds.

Runway AI Video to Video prompting guide

Every example in the guide shows what was in the original video and what changed after the prompt was applied, so you can clearly see how different instructions influence the final result.

So, use these as an inspiration to write an excellent prompt about what you want to change in the uploaded video. For example: add, remove, change, replace, relight, or restyle. Then, include a description of the transformation.

Step 4. Generate Your Video

Alright, this is the final stretch of the process.

Once you've uploaded your clip, written your prompt, and adjusted everything the way you want, the next step is simple. You just select the aspect ratio for your output. This depends on where you plan to use the video: it's vertical, square, or widescreen. Pick the format that makes sense for your project.

After that, you click Generate.

When the render is complete, the output will appear in the right-side window. That's where you can preview the result, check if the edit worked the way you intended, and decide if you want to refine the prompt or use another image reference.

Now here's something important you need to know.

Runway Gen 4, which powers Aleph, is a paid feature. You have to be on a paid plan to use it. Even if you're on the free plan and receive free credits, this specific tool isn't available during the free trial. So if you don't see the option working, it's most likely because your account isn't on a paid subscription yet.

Once the video is generated, name your session, and it will be saved on the Runway cloud, where you can access it and download it from there.

Saving the generated video session in Runway

Part 3. Using Chat Mode for Runway AI Video to Video Generation

Gen-4 Aleph isn't limited to the Edit Video tool. You can also access it through Runway's Chat mode, which gives you another way to interact with the model and generate a video using your own clip.

Step 1. Access Runway Chat Mode

To use it this way, go back to the main Runway dashboard. On the left-hand side, you'll see a vertical menu with different icons. Among them is the Chat icon. Click that to open the Chat interface.

That's where you can begin working with Gen-4 Aleph through the chat-based workflow instead of the standard editing panel.

Step 2. Upload Video to Runway Chat

Then, click + to upload your video either through your computer or with the assets you already generated in Runway.

Uploading the video in Runway Chat mode

Chat mode works more like a virtual creative assistant inside Runway. It's not just for editing clips. You can use it to create images, generate videos, brainstorm ideas, or even shape out basic narratives. It gives you that conversational feel, so instead of clicking through different menu options, you're interacting with it through instructions.

Inside this section, you'll also find many video editing examples. When you click any of that, it shows you different types of edits you can perform. It tells you what's possible.

The examples cover things like changing the background or setting, adjusting the camera angle, modifying objects or characters in a scene, and similar kinds of edits. When you select one of those examples, it basically guides you by showing what kind of prompt you would type into the chat box to achieve that result.

Reviewing Runway Video to Video chat capabilities

So instead of guessing what to write, you can look at those example prompts to guide Runway on what to do with your uploaded video asset.

Step 3. Customize Chat Settings

Inside Chat mode, you'll notice that there are different model selection options available. One of the main options is All. When you select this, Chat mode automatically chooses what it considers the best model for the task you're trying to perform. So if you're generating another video from a clip, it decides which model fits that request. Just keep in mind that the cost can vary depending on which model it selects behind the scenes.

Then there's the Runway Only option. As the name suggests, this setting limits everything strictly to Runway's own models. This mode focuses on speed, quicker iterations, and stronger control over the output.

Selecting the chat settings for Runway AI Video to Video

You'll also see a Custom Model option. This allows you to manually choose which model you want to use. However, for video generation specifically, the only supported model right now is Runway Gen 4.5.

So at the moment, the simplest and most reliable choice is to select Runway Only, especially if you want consistent behavior without worrying about automatic model switching.

Step 4. Set the Aspect Ratio

In the video settings section, you'll see the option to choose your aspect ratio. You can select from standard formats like 16:9, 1:1, or 9:16, depending on where you plan to use the video. So if you're creating something for YouTube, Instagram, or vertical platforms, you just pick the format that fits.

Choosing an aspect ratio in Runway AI chat

If you don't see the exact aspect ratio you're looking for, you can request a different one directly in the chat. That said, not every ratio will be supported for every type of request. Some edits may allow it, while others might not.

Step 5. Generate and Save

Once you've finished writing your prompt and reviewed everything, all you have to do is click the upward arrow to submit it. The moment you do that, the chatbot starts processing your request and begins editing the video based on the instructions you gave.

Regenerating a video in Runway chat mode

On the right side of the screen, you'll see a progress bar showing that the generation is in motion. Just be aware that this process can consume a significant number of credits, depending on the complexity of the edit.

Also, this generation feature requires a paid plan. If you're not subscribed to a paid tier, the system won't allow you to run these edits.

After the video is generated, you'll need to name the session. Once you do that, it gets saved automatically under your recent sessions, so you can come back to it later without losing your work.

Part 4. FAQs of Runway AI Video to Video

Q1. What happened to uploading videos in Runway?

A1. Runway doesn't have a dedicated old-style "video to video" button as earlier Gen-3 models did. Now, video-to-video generations are done by uploading a clip and using prompt-driven editing workflows such as Edit Video with Aleph or AI Chat, which regenerate new footage based on instructions.

Q2. How do prompt details affect Runway video-to-video results?

A2. Your prompt is everything. If you're vague, the video changes might be unclear. Describing exactly what you want changed, where, and how helps Runway's AI understand the transformation better. Including reference images can also guide colors, styling, or lighting based on what you want in the newly AI-generated video.

Q3. What kinds of AI video workflows does Runway support today?

A3. Runway offers more than one video workflow. It includes text-to-video generation, image-to-video, motion tracking, and video editing powered by AI, which lets you change scenes, restyle subjects, or add elements to footage through prompts and edits.

Conclusion on Runway AI Video to Video

To wrap this up, the Runway AI Video to Video generation is now embedded in Gen-4 Aleph and the Chat mode, which offers you great convenience to regenerate your clips. Instead of relying on a separate tool like before, everything now works through guided editing and prompt-driven regeneration inside the platform.

But again, the key thing here lies in your prompting.

You can upload your footage, choose how you want it changed, and let the AI edit parts of the clip based on your instructions. However, the quality of the result depends on how clearly and precisely you describe what you want. The stronger and more specific your prompt is, the better your regenerated video will turn out.

Select the product rating:

HitPaw Online blogs

Leave a Comment

Create your review for HitPaw articles

Recommend Products

HitPaw Univd

HitPaw Univd

All-in-one video, audio, and image converting and editing solutions.

HitPaw Video enhancer

HitPaw VikPea

Batch upscale videos with only one click. Powered by trained AI.

download
Click Here To Install