Skip navigation.

Opera Desktop Team

A peek under the hood

, ,

Today's post will be a bit unusual in the sense that it won't be about Opera itself, but rather about how Opera is brought to you. This post will attempt to explain to you how we get from a lump of source code that can be compiled in a lot of different ways with many different options to the Opera packages that you can download and install from this blog.

Install? That is already a complex process on its own. You do it once and never think about it again, but the fact is that installation is a crucial process and it has to work properly, otherwise you can't enjoy your favorite software! So, how do we fit all our code in an executable, then pack it in an installer?

There are essentially two processes that take part here: Building and packaging. We have a build system that realizes both of them. The first part of it is a web interface that collects build requests from everyone and then dispatches them to our build servers, each of which can make a build for the requested OS. The second part is a script, partly different for each OS, running on each build server which takes care of building and packaging.

The building part is pretty much the same on each platform: it obtains the requested version of the source code, compiles it with the right options and builds it into an executable (and libraries). The compilation part is taken care of by a compiler specific to the platform on which the build is made and it mostly takes care of itself, as long as the source code is correct.

At that point, everything is ready for packaging, and the script becomes very different depending on the OS. I will talk more specifically about packaging on Windows, since I am responsible for the Windows part of the build system.

There are two kind of packages on Windows: MSI packages made with InstallShield and "Classic" packages made using an old version of the WISE installer. The WISE installer is relatively easy to configure. It takes a sort of installation script, written in its own scripting language, and just executes it. It uses an additional DLL to realize functions that are not possible with only the script itself (like detecting Windows Vista). Although it is nice and easy, the WISE installer is not very well adapted to Windows versions more recent than Windows 98.

InstallShield is a much more powerful tool and MSI installers are a lot more complicated to put together. I won't get into much details here, but there is a huge amount of configuration that can be applied to an InstallShield package. It relies on an ISM file (Installer definition) which is XML formatted and indicates what the package should do, once compiled.

The packaging script starts by opening the installer definition file and set up a few things in it, preparing languages and translations of the installer itself. It enumerates all the files that need to be in the package and puts them in the right place. After a few more tweaks it builds the MSI package. The process is done once for each MSI package. The WISE installer is built along with the english-only MSI package but the process is trivial in comparison.

Maintaining and improving the build system and packaging scripts is no small task, but also an important task. Without it all builds and packages would have to be made manually!

This was it, a small peek at a hidden, but important part of Opera development.

In other news, our QA team has started their own blog - head over to the new QA blog for more peeks "under the hood".



Changelog:
  • Fixed a URL encoding issue in javascript: URLs
  • Fixed an issue with the BBC iPlayer RealPlayer plugin not working
  • Several stability fixes
  • Fixed a problem where GMail would not load



Download
Windows
Windows Classic
Macintosh
UNIX

Opera 9.52 snapshot "summer edition" File I/O, Video, 3D Canvas - all in one go!

Comments

sebt 18. July 2008, 15:03

Thanks for the heads up and the new build.

Got here first for a change.. Yay :D

Seb :smile:

skye11 18. July 2008, 15:06

thanx!

Cyro 18. July 2008, 15:09

Neato!

Andrew Nguyen 18. July 2008, 15:14

:up:

The YeOK 18. July 2008, 15:16

Thanks for the build, and thanks for taking the time to give us an insight into the Opera build process.

Matthias 18. July 2008, 15:17

Thanks for the new build :smile:

Nice information about building and packaging Opera!

Anna 18. July 2008, 15:28

Yay Gmail 1 works beautifully now!! Thank you!!

nahtanoj999 18. July 2008, 15:28

In GMail 2, you still can't type into the rich-text field if it is empty. You can get around this by switching into plain-text mode, typing a little, and then switching back. It's no big deal, but kind of annoying.

Edward 18. July 2008, 15:30

Thanks! 10th :D

lamarca 18. July 2008, 15:32

thanks for the new snapshot

MossMan 18. July 2008, 15:32

Interesting - but I'll still be using the classic installer... sorry! :smile:

Manuel 18. July 2008, 15:37

Interesting story. In comparison with my software I see many similiarities :smile:.

ElectriX2 18. July 2008, 15:38

Thank you, but still build 10089 in right menu...

MAXAITA 18. July 2008, 15:38

Mod edit: English please.

YeahRight 18. July 2008, 15:39

I thought I was the only one with the Gmail loading (and loading...) issue but it seems too work better than before, so thanx! :smile:

I hope that Opera keeps the Classic installer. The most important thing I dislike about MSI is that a copy of it will be written on the c-partition. I would like too keep this partition as clean as possible (defragmentation -> speed). One suggestion if there's only a MSI version available: disable the Windows Installer service and remove the MSI. Manually run the service when you want to do a installation.

Jim

Andres Rodriguez Guapacha 18. July 2008, 15:54

Thanks for the info! it is always a pleasant sensation to know how things are done.

zenocha 18. July 2008, 15:56

There is an issue on www.channel4.com/watch_online where a server login dialogue appears that does not in other browsers and shows cannot be watched due to the play button not appearing.

PiTRiS 18. July 2008, 16:01

yeah, encoding i JS finally fixed :smile:)
and now the selecting of urls by double click pls :smile:)

Viljami 18. July 2008, 16:01

gmail still doesn't work for me. Loading bar stops just before its complited. Have to use html-view

Luis Carlos Carvalho 18. July 2008, 16:04

Opera is still not open PDF's with Adobe Plugin.:frown:

Jochen Gress 18. July 2008, 16:05

I don't need no useless stability fixes, while bigger bugs still remains.

When will Opera be compatible to many web boards again? Since 9.5, the cursor jumps to the first line when using smilies at bulletin boards, and also here at your own opera boards. That is a big regression to 9.2x

:frown:

Cosma Sebastian Adrian 18. July 2008, 16:19

Nice. Thanks :smile:

Charlie 18. July 2008, 16:20

Thanks for the Gmail loading fix! I agree with YeahRight - I hope Opera doesn't do away with the Classic Installer. :smile:

Nameless Voice 18. July 2008, 16:26

Is the MSI installer ever going to regain the option to install to a single folder rather than the user's profile?


"In GMail 2, you still can't type into the rich-text field if it is empty."

It works for me if I click on the first line - it just won't focus the box if you click lower down.

thobi 18. July 2008, 16:27

thx! :smile:

Przemysław 18. July 2008, 16:36

Julien, why Opera can't update itself by downloading particular files instead of downloading whole installer?

The update process would be more automatized and faster...

Bartek Sumowski 18. July 2008, 16:37

GMail does not work, it still hangs! After clean install on two PCs still nothing...

It's always forcing me to use GMail 2.0.

g4qb 18. July 2008, 16:48

Piotr 18. July 2008, 16:49

EricJH 18. July 2008, 16:59

Thx for the new build and a little look under the hood.

Idan Adar 18. July 2008, 17:04

Use NSIS instead of WISE for the Classic installer.

nahtanoj999 18. July 2008, 17:05

"It works for me if I click on the first line - it just won't focus the box if you click lower down."

Ah. Thanks, I didn't notice that. It's still a little annoying though.

ayespy 18. July 2008, 17:14

Whatever you did to fix gmail loading for some (and it was already loading for me) seems to have fixed access to https://www.nvcontractorsboard.com as well. Thank you. No more switching to FF3 to complete job tasks = smoother workflow.

Peter 18. July 2008, 17:16

Originally posted by YtseJam:

Use NSIS instead of WISE for the Classic installer.



Good suggestion - I was afraid that the blog above implied ceasing the Classic version and I really don't want any of Opera on C:\. If this move would preserve Classic and be easier for The Team, go for it!

Morphdreamer 18. July 2008, 17:33

100% processor usage all the time :worried:

Charles Schloss 18. July 2008, 17:40

On the Mac version of Opera can it be set up so the pdf documents open in Opera using preveiw just like in Safai, Also please update The IE user agent string to IE 7 from IE 6

rseiler 18. July 2008, 17:52

Originally posted by YeahRight:

The most important thing I dislike about MSI is that a copy of it will be written on the c-partition.


What?

Mark Gillespie 18. July 2008, 17:59

SO in summary, the MSI package is the most complicated (read troublesome), and is the one users like the least...

None of my sytems even work with the MSI versions, as it falls over installing to subst directories and rolls back. I am always forced to use the classic installer, which almost works, but installs a annoying zero byte broken shortcut...

I would be happier, frankly, with a ZIP file....

YeahRight 18. July 2008, 18:01

@rseiler

"What?" Please specify your question, thx.

decmk 18. July 2008, 18:08

Great Build! btw try to download DAEMON Tools Lite from this link
http://www.disk-tools.com/request?p=8e056bfe7f4c0c0473cfa7fbb7f9b36a/daemon4300-lite.exe

opera show download dialog with Type: HTML Document ????? :yikes:

and try to save as htm file.

Bartek Sumowski 18. July 2008, 18:11

all MSI packages are in C:\Program Files\InstallShield Installation Information

there are copies, roll backs etc in there, GARBAGE

My GMail still ain't working, I'm on Windows if it matters.

rseiler 18. July 2008, 18:17

Originally posted by YeahRight:

"What?" Please specify your question, thx.


What does "a copy of it will be written on the c-partition" mean exactly? There are several ways to interpret it.

illiad 18. July 2008, 18:20

and again... WHY does FF manage with one install type, where opera does not?????

Gousti Fruit 18. July 2008, 18:22

Well, you should really use Inno Setup :-)

YeahRight 18. July 2008, 18:34

@rseiler

A exact copy of the given MSI package will be written on your C-partition after a installation for reference each time you run a executable installed with this package. Search for *.msi on your C:\ for possible examples. More details on http://en.wikipedia.org/wiki/Windows_Installer

YeahRight 18. July 2008, 18:37

@GoustiFruit

Great arguments :wink:

lwiczek 18. July 2008, 18:39

Is the MSI installer ever going to regain the option to install to a single folder rather than the user's profile?



huge +1 :smile:

Well, you should really use Inno Setup :-)



I also prefer IS, particularly the way it lets user chose location of files.

flaxthejute 18. July 2008, 18:43

@cranil7

Why should they fix your bug when nobody's even mentioned mine (bug-325347) :frown:

user258 18. July 2008, 18:55

Putting the msi file on the c drive without an optional location screws up users who have built their systems with a separate boot partition on c and want to keep their c drive small so they can quickly make images and keep large numbers of them in case they need to go back.

bpm 18. July 2008, 19:12

Non-destructive install that leaves old Opera working (to be uninstalled when user is sure upgrade has worked & is a keeper) would sure save a lot of trauma. Clone profile, upgrade clone.

Write a comment

You must be logged in to write a comment. If you're not a registered member, please sign up.