How to build applications with OpenCV inside the Microsoft Visual Studio — OpenCV 2.4.6.1 documentation

### Navigation

- index
- next |
- previous |
- OpenCV 2.4.6.1 documentation »
- OpenCV Tutorials »
- Introduction to OpenCV »

# How to build applications with OpenCV inside the Microsoft Visual Studio

Everything I describe here will apply to the C\C++ interface of OpenCV. I start out from the assumption that you have read and completed with success the Installation in Windows tutorial. Therefore, before you go any further make sure you have an OpenCV directory that contains the OpenCV header files plus binaries and you have set the environment variables as described here.

The OpenCV libraries, distributed by us, on the Microsoft Windows operating system are in a Dynamic Linked Libraries (DLL). These have the advantage that all the content of the library are loaded only at runtime, on demand, and that countless programs may use the same library file. This means that if you have ten applications using the OpenCV library, no need to have around a version for each one of them. Of course you need to have the dll of the OpenCV on all systems where you want to run your application.

Another approach is to use static libraries that have lib extensions. You may build these by using our source files as described in the Installation in Windows tutorial. When you use this the library will be built-in inside your exe file. So there is no chance that the user deletes them, for some reason. As a drawback your application will be larger one and as, it will take more time to load it during its startup.

To build an application with OpenCV you need to do two things:

- Tell to the compiler how the OpenCV library looks. You do this by showing it the header files.

- Tell to the linker from where to get the functions or data structures of OpenCV, when they are needed.

  If you use the lib system you must set the path where the library files are and specify in which one of them to look. During the build the linker will look into these libraries and add the definitions and implementation of all used functions and data structures to the executable file.

  If you use the DLL system you must again specify all this, however now for a different reason. This is a Microsoft OS specific stuff. It seems that the linker needs to know that where in the DLL to search for the data structure or function at the runtime. This information is stored inside lib files. Nevertheless, they aren’t static libraries. They are so called import libraries. This is why when you make some DLLs in Windows you will also end up with some lib extension libraries. The good part is that at runtime only the DLL is required.

To pass on all this information to the Visual Studio IDE you can either do it globally (so all your future projects will get these information) or locally (so only for you current project). The advantage of the global one is that you only need to do it once; however, it may be undesirable to clump all your projects all the time with all these information. In case of the global one how you do it depends on the Microsoft Visual Studio you use. There is a 2008 and previous versions and a 2010 way of doing it. Inside the global section of this tutorial I’ll show what the main differences are.

The base item of a project in Visual Studio is a solution. A solution may contain multiple projects. Projects are the building blocks of an application. Every project will realize something and you will have a main project in which you can put together this project puzzle. In case of the many simple applications (like many of the tutorials will be) you do not need to break down the application into modules. In these cases your main project will be the only existing one. Now go create a new solution inside Visual studio by going through the File ‣ New ‣ Project menu selection. Choose Win32 Console Application as type. Enter its name and select the path where to create it. Then in the upcoming dialog make sure you create an empty project.

## The local method

Every project is built separately from the others. Due to this every project has its own rule package. Inside this rule packages are stored all the information the IDE needs to know to build your project. For any application there are at least two build modes: a Release and a Debug one. The Debug has many features that exist so you can find and resolve easier bugs inside your application. In contrast the Release is an optimized version, where the goal is to make the application run as fast as possible or to be as small as possible. You may figure that these modes also require different rules to use during build. Therefore, there exist different rule packages for each of your build modes. These rule packages are called inside the IDE as project properties and you can view and modify them by using the Property Manger. You can bring up this with View ‣ Property Pages. Expand it and you can see the existing rule packages (called Proporty Sheets).

The really useful stuff of these is that you may create a rule package once and you can later just add it to your new projects. Create it once and reuse it later. We want to create a new Property Sheet that will contain all the rules that the compiler and linker needs to know. Of course we will need a separate one for the Debug and the Release Builds. Start up with the Debug one as shown in the image below:

Use for example the OpenCV_Debug name. Then by selecting the sheet Right Click ‣ Properties. In the following I will show to set the OpenCV rules locally, as I find unnecessary to pollute projects with custom rules that I do not use it. Go the C++ groups General entry and under the “Additional Include Directories” add the path to your OpenCV include. If you don’t have “C/C++” group, you should add any .c/.cpp file to the project.

    $(OPENCV_DIR)\include

When adding third party libraries settings it is generally a good idea to use the power behind the environment variables. The full location of the OpenCV library may change on each system. Moreover, you may even end up yourself with moving the install directory for some reason. If you would give explicit paths inside your property sheet your project will end up not working when you pass it further to someone else who has a different OpenCV install path. Moreover, fixing this would require to manually modifying every explicit path. A more elegant solution is to use the environment variables. Anything that you put inside a parenthesis started with a dollar sign will be replaced at runtime with the current environment variables value. Here comes in play the environment variable setting we already made in our previous tutorial.

Next go to the Linker ‣ General and under the “Additional Library Directories” add the libs directory:

    $(OPENCV_DIR)\libs

Then you need to specify the libraries in which the linker should look into. To do this go to the Linker ‣ Input and under the “Additional Dependencies” entry add the name of all modules which you want to use:

The names of the libraries are as follow:

    opencv_(The Name of the module)(The version Number of the library you use)d.lib

A full list, for the latest version would contain:

    opencv_core231d.lib
    opencv_imgproc231d.lib
    opencv_highgui231d.lib
    opencv_ml231d.lib
    opencv_video231d.lib
    opencv_features2d231d.lib
    opencv_calib3d231d.lib
    opencv_objdetect231d.lib
    opencv_contrib231d.lib
    opencv_legacy231d.lib
    opencv_flann231d.lib

The letter d at the end just indicates that these are the libraries required for the debug. Now click ok to save and do the same with a new property inside the Release rule section. Make sure to omit the d letters from the library names and to save the property sheets with the save icon above them.

You can find your property sheets inside your projects directory. At this point it is a wise decision to back them up into some special directory, to always have them at hand in the future, whenever you create an OpenCV project. Note that for Visual Studio 2010 the file extension is props, while for 2008 this is vsprops.

Next time when you make a new OpenCV project just use the “Add Existing Property Sheet...” menu entry inside the Property Manager to easily add the OpenCV build rules.

## The global method

In case you find to troublesome to add the property pages to each and every one of your projects you can also add this rules to a “global property page”. However, this applies only to the additional include and library directories. The name of the libraries to use you still need to specify manually by using for instance: a Property page.

In Visual Studio 2008 you can find this under the: Tools ‣ Options ‣ Projects and Solutions ‣ VC++ Directories.

In Visual Studio 2010 this has been moved to a global property sheet which is automatically added to every project you create:

The process is the same as described in case of the local approach. Just add the include directories by using the environment variable OPENCV_DIR.

## Test it!

Now to try this out download our little test `source code` or get it from the sample code folder of the OpenCV sources. Add this to your project and build it. Here’s its content:

      1
      2
      3
      4
      5
      6
      7
      8
      9
     10
     11
     12
     13
     14
     15
     16
     17
     18
     19
     20
     21
     22
     23
     24
     25
     26
     27
     28
     29
     30
     31
     32
     33
     34
     35
     36
     37
     38
     39
     40
     41
     42
     43
     44
     45
     46
     47
     48
     49
     50
     51
     52
     53
     54
     55
     56
     57
     58
     59
     60
     61
     62
     63
     64
     65
     66
     67
     68
     69
     70
     71
     72
     73
     74
     75
     76
     77
     78
     79
     80
     81
     82
     83
     84
     85
     86
     87
     88
     89
     90
     91
     92
     93
     94
     95
     96
     97
     98
     99
    100
    101
    102
    103
    104
    105
    106
    107
    108
    109
    110
    111
    112
    113
    114
    115
    116
    117
    118
    119
    120
    121
    122
    123
    124
    125
    126
    127
    128
    129
    130
    131
    132
    133
    134
    135
    136
    137
    138
    139
    140
    141
    142
    143
    144
    145
    146
    147
    148
    149
    150
    151
    152
    153
    154
    155
    156
    157
    158
    159
    160
    161
    162
    163
    164
    165
    166
    167
    168
    169
    170
    171
    172
    173
    174
    175
    176
    177
    178
    179
    180
    181
    182
    183
    184
    185
    186
    187
    188
    189
    190
    191
    192
    193
    194
    195
    196
    197
    198
    199
    200
    201
    202
    203
    204
    205
    206
    // Video Image PSNR and SSIM
    #include <iostream> // for standard I/O
    #include <string>   // for strings
    #include <iomanip>  // for controlling float print precision
    #include <sstream>  // string to number conversion

    #include <opencv2/imgproc/imgproc.hpp>  // Gaussian Blur
    #include <opencv2/core/core.hpp>        // Basic OpenCV structures (cv::Mat, Scalar)
    #include <opencv2/highgui/highgui.hpp>  // OpenCV window I/O

    using namespace std;
    using namespace cv;

    double getPSNR ( const Mat& I1, const Mat& I2);
    Scalar getMSSIM( const Mat& I1, const Mat& I2);

    static void help()
    {
        cout
            << "\n--------------------------------------------------------------------------" << endl
            << "This program shows how to read a video file with OpenCV. In addition, it tests the"
            << " similarity of two input videos first with PSNR, and for the frames below a PSNR "  << endl
            << "trigger value, also with MSSIM."<< endl
            << "Usage:"                                                                       << endl
            << "./video-source referenceVideo useCaseTestVideo PSNR_Trigger_Value Wait_Between_Frames " << endl
            << "--------------------------------------------------------------------------"   << endl
            << endl;
    }
    int main(int argc, char *argv[])
    {
        help();
        if (argc != 5)
        {
            cout << "Not enough parameters" << endl;
            return -1;
        }
        stringstream conv;

        const string sourceReference = argv[1],sourceCompareWith = argv[2];
        int psnrTriggerValue, delay;
        conv << argv[3] << argv[4];       // put in the strings
        conv >> psnrTriggerValue >> delay;// take out the numbers

        char c;
        int frameNum = -1;          // Frame counter

        VideoCapture captRefrnc(sourceReference),
                     captUndTst(sourceCompareWith);

        if ( !captRefrnc.isOpened())
        {
            cout  << "Could not open reference " << sourceReference << endl;
            return -1;
        }

        if( !captUndTst.isOpened())
        {
            cout  << "Could not open case test " << sourceCompareWith << endl;
            return -1;
        }

        Size refS = Size((int) captRefrnc.get(CV_CAP_PROP_FRAME_WIDTH),
                         (int) captRefrnc.get(CV_CAP_PROP_FRAME_HEIGHT)),
             uTSi = Size((int) captUndTst.get(CV_CAP_PROP_FRAME_WIDTH),
                         (int) captUndTst.get(CV_CAP_PROP_FRAME_HEIGHT));

        if (refS != uTSi)
        {
            cout << "Inputs have different size!!! Closing." << endl;
            return -1;
        }

        const char* WIN_UT = "Under Test";
        const char* WIN_RF = "Reference";

        // Windows
                namedWindow(WIN_RF, CV_WINDOW_AUTOSIZE );
                namedWindow(WIN_UT, CV_WINDOW_AUTOSIZE );
                cvMoveWindow(WIN_RF, 400       ,            0);      //750,  2 (bernat =0)
                cvMoveWindow(WIN_UT, refS.width,            0);      //1500, 2

        cout << "Frame resolution: Width=" << refS.width << "  Height=" << refS.height
             << " of nr#: " << captRefrnc.get(CV_CAP_PROP_FRAME_COUNT) << endl;

        cout << "PSNR trigger value " <<
              setiosflags(ios::fixed) << setprecision(3) << psnrTriggerValue << endl;

        Mat frameReference, frameUnderTest;
        double psnrV;
        Scalar mssimV;

        for(;;) //Show the image captured in the window and repeat
        {
            captRefrnc >> frameReference;
            captUndTst >> frameUnderTest;

            if( frameReference.empty()  || frameUnderTest.empty())
            {
                cout << " < < <  Game over!  > > > ";
                break;
            }

            ++frameNum;
            cout <<"Frame:" << frameNum;

            ///////////////////////////////// PSNR ////////////////////////////////////////////////////
            psnrV = getPSNR(frameReference,frameUnderTest);                 //get PSNR
            cout << setiosflags(ios::fixed) << setprecision(3) << psnrV << "dB";

            //////////////////////////////////// MSSIM /////////////////////////////////////////////////
            if (psnrV < psnrTriggerValue)
            {
                mssimV = getMSSIM(frameReference,frameUnderTest);

                cout << " MSSIM: "
                     << "R" << setiosflags(ios::fixed) << setprecision(3) << mssimV.val[2] * 100
                     << "G" << setiosflags(ios::fixed) << setprecision(3) << mssimV.val[1] * 100
                     << "B" << setiosflags(ios::fixed) << setprecision(3) << mssimV.val[0] * 100;
            }

           cout << endl;

            ////////////////////////////////// Show Image /////////////////////////////////////////////
            imshow( WIN_RF, frameReference);
            imshow( WIN_UT, frameUnderTest);

            c = (char)cvWaitKey(delay);
            if (c == 27) break;
        }

        return 0;
    }

    double getPSNR(const Mat& I1, const Mat& I2)
    {
        Mat s1;
        absdiff(I1, I2, s1);       // |I1 - I2|
        s1.convertTo(s1, CV_32F);  // cannot make a square on 8 bits
        s1 = s1.mul(s1);           // |I1 - I2|^2

        Scalar s = sum(s1);         // sum elements per channel

        double sse = s.val[0] + s.val[1] + s.val[2]; // sum channels

        if( sse <= 1e-10) // for small values return zero
            return 0;
        else
        {
            double  mse =sse /(double)(I1.channels() * I1.total());
            double psnr = 10.0*log10((255*255)/mse);
            return psnr;
        }
    }

    Scalar getMSSIM( const Mat& i1, const Mat& i2)
    {
        const double C1 = 6.5025, C2 = 58.5225;
        /***************************** INITS **********************************/
        int d     = CV_32F;

        Mat I1, I2;
        i1.convertTo(I1, d);           // cannot calculate on one byte large values
        i2.convertTo(I2, d);

        Mat I2_2   = I2.mul(I2);        // I2^2
        Mat I1_2   = I1.mul(I1);        // I1^2
        Mat I1_I2  = I1.mul(I2);        // I1 * I2

        /*************************** END INITS **********************************/

        Mat mu1, mu2;   // PRELIMINARY COMPUTING
        GaussianBlur(I1, mu1, Size(11, 11), 1.5);
        GaussianBlur(I2, mu2, Size(11, 11), 1.5);

        Mat mu1_2   =   mu1.mul(mu1);
        Mat mu2_2   =   mu2.mul(mu2);
        Mat mu1_mu2 =   mu1.mul(mu2);

        Mat sigma1_2, sigma2_2, sigma12;

        GaussianBlur(I1_2, sigma1_2, Size(11, 11), 1.5);
        sigma1_2 -= mu1_2;

        GaussianBlur(I2_2, sigma2_2, Size(11, 11), 1.5);
        sigma2_2 -= mu2_2;

        GaussianBlur(I1_I2, sigma12, Size(11, 11), 1.5);
        sigma12 -= mu1_mu2;

        ///////////////////////////////// FORMULA ////////////////////////////////
        Mat t1, t2, t3;

        t1 = 2 * mu1_mu2 + C1;
        t2 = 2 * sigma12 + C2;
        t3 = t1.mul(t2);              // t3 = ((2*mu1_mu2 + C1).*(2*sigma12 + C2))

        t1 = mu1_2 + mu2_2 + C1;
        t2 = sigma1_2 + sigma2_2 + C2;
        t1 = t1.mul(t2);               // t1 =((mu1_2 + mu2_2 + C1).*(sigma1_2 + sigma2_2 + C2))

        Mat ssim_map;
        divide(t3, t1, ssim_map);      // ssim_map =  t3./t1;

        Scalar mssim = mean( ssim_map ); // mssim = average of ssim map
        return mssim;
    }

You can start a Visual Studio build from two places. Either inside from the IDE (keyboard combination: `Control-F5`) or by navigating to your build directory and start the application with a double click. The catch is that these two aren’t the same. When you start it from the IDE its current working directory is the projects directory, while otherwise it is the folder where the application file currently is (so usually your build directory). Moreover, in case of starting from the IDE the console window will not close once finished. It will wait for a keystroke of yours.

This is important to remember when you code inside the code open and save commands. You’re resources will be saved ( and queried for at opening!!!) relatively to your working directory. This is unless you give a full, explicit path as parameter for the I/O functions. In the code above we open `this OpenCV logo`. Before starting up the application make sure you place the image file in your current working directory. Modify the image file name inside the code to try it out on other images too. Run it and voilá:

## Command line arguments with Visual Studio

Throughout some of our future tutorials you’ll see that the programs main input method will be by giving a runtime argument. To do this you can just start up a commmand windows (`cmd + Enter` in the start menu), navigate to your executable file and start it with an argument. So for example in case of my upper project this would look like:

    1
    2
    3
    D:
    CD OpenCV\MySolutionName\Release
    MySolutionName.exe exampleImage.jpg

Here I first changed my drive (if your project isn’t on the OS local drive), navigated to my project and start it with an example image argument. While under Linux system it is common to fiddle around with the console window on the Microsoft Windows many people come to use it almost never. Besides, adding the same argument again and again while you are testing your application is, somewhat, a cumbersome task. Luckily, in the Visual Studio there is a menu to automate all this:

Specify here the name of the inputs and while you start your application from the Visual Studio enviroment you have automatic argument passing. In the next introductionary tutorial you’ll see an in-depth explanation of the upper source code: Load and Display an Image.

## Help and Feedback

You did not find what you were looking for?

- Ask a question on the Q&A forum.
- If you think something is missing or wrong in the documentation, please file a bug report.

### Navigation

- index
- next |
- previous |
- OpenCV 2.4.6.1 documentation »
- OpenCV Tutorials »
- Introduction to OpenCV »