You can yes…just by the first tutorial link I pasted above. Use a plugin Display Widgets for that. You upload your banners (images) to your media library and copy the image file URL and then use a text widget with html such as:
Then the plugin adds at the bottom of each widget, settings to choose where you want to show that one on what page. Do the same thing for additional pages and banners.