Skip to main content

Python, Flask, Concurrency and Windows

This blog is for those who have written a program in Python and exposed it as API using Flask. You might have written the python algorithm and will be happy to see the output. With small usage and limited users, it still works by making some configuration changes. Problem arises when you host the same API in Production where multiple users are browsing it.

Why it does not work in Production as local environment?
In production, mutiple requests come to server from mutiple locations. If setup is not tuned to cater to concurrent users, either these requests will make the API down or will be throwing exception like 'Internal server error'.

How can we configure the setup to serve concurrent users?
There are few configuration which you have to keep in mind while designing the eco system to accomodate mutiple users.

  1. Make sure Python is installed on server. Download
  2. Download pip from and run command python
  3. Install Flask using pip commands pip install Flask
  4. Open command prompt, run python [filename].py and check your python file is running using Flask.
  5. Install Apache from Apache Lounge and install it as service. Check http://localhost and apache default page should appear. 
    • Open command prompt and goto Apache directory
    • run httpd.exe -k install
    • Open service.msc and look fot Apache service
    • Right click and run it as Automatic
  6. Install mod_wsgi(component for concurrency) using command pip install mod_wsgi
  7. Run command mod_wsgi-express module-config and this will produce output somthing like LoadModule wsgi_module...These are the directives needed to configure Apache to load mod_usgi.
  8. Copy the above output and paste it in [apache home directoty]/conf/httpd.conf at the bottom of the file. 
  9. Modify the Apache confirguration to listen to desired port. Open [apache home directoty]/conf/extra/httpd-vhosts.conf
    • <VirtualHost *:5000>
    •         ServerAdmin admin-name-here
    •         ServerName localhost:5000
    •        WSGIScriptAlias / "C:/Sumit Bajaj/web.wsgi"
    •         DocumentRoot "C:/Sumit Bajaj"
    •         <Directory "C:/Sumit Bajaj">
    •               Require all granted
    •         </Directory>       
    •         ErrorLog "C:/Sumit Bajaj/logs/error.log"
    •         CustomLog "C:/Sumit Bajaj/logs/access.log" common
    • </VirtualHost>
  10. In the above example "C:/Sumit Bajaj" is directory where python file resides. If web.wsgi file does not exists in the folder, create one. 
  11. Copy these lines into web.wsgi file - 
    • import sys
    • sys.path.insert(0, 'C:\Sumit Bajaj')
    • from app import app as application
  12. After all these steps, your file should be running using mod_usgi on Apache.
  13. Even after your setup is not working. See FAQs below.
Python ecoSystem to support concurrency

Frequently Asked Questions(FAQs)

Apache is giving port not found exception 
Open [apache home directoty]/conf/httpd.conf  and search for 'Listen' and make sure your desired port is added to Listen.

Where mod_wsgi directly exists on windows?
It should be in [Python_directory]/lib/. If you are not able to find, search for web.wsgi file and you will get the directory.

Module is not available
While runnig this experiment, if you get execption 'Module is not available', don't get discouraged. Browse the module on internet and install it.

Can we tune flask to run mutiple threads?
Use"", port="5000", threaded=True) rather than default

After using Flask, mod_usgi and Apache, application is not able to feed concurrent requests

  1. Check your hardware
  2. If server has enough resources to server mutiple request. Check your Python code for improvement. In Python there is concept of Global Interpreter Lock(GIL) is a mutex which prevents access to Python objects for multithreaded environment. You may use threading library and lock the object till its work is completed. Read more on Python threading

Should I run Python on Windows or Linux?
Python and dependent libraries are better supported on Linux OS rather than windows, so I will recommended to use Linux. However, if your exisitng ecoSystem does not support it, nothing to worry. This blog is for you.

Please share your queries in comments and I will put my best to answer. 


Popular posts from this blog

Cannot alter the login 'sa', because it does not exist or you do not have permission.

Working on projects, it can happen that 'sa' account gets locked. If it is on local machine OR development boxes, onus would be on you to fix it. If scripts and SQL steps are not working, this might help you fixing the issue. Steps to unlock 'sa' account and resetting the password. 1. Open SQL Server Configuration Manager 2. Select SQL Server Services -> 'SQL Server' service. 3. Right click on 'SQL Server' service and click on "Startup Parameters". For 2008, server "Startup Parameters" are inside Advanced tab.   4. Add '-m' in startup parameters as shown above and click on 'Add'. This will put SQL server into 'Single User Mode' and local admin will have 'Super User' rights. For 2008, server you have to add ':-m' in the last of the existing query. 5. Save the settings and Restart the service. 6. Now open the SQL Server Management Studio and connect to database using 'Windows A

Could not load file or assembly 'Microsoft.Web.Infrastructure'

Could not load file or assembly 'Microsoft.Web.Infrastructure, Version=, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified. What 'Micorosoft.Web.Infrastructure' does? This dll lets HTTP modules register at run time. Solution to above problem: Copy 'Micorosoft.Web.Infrastructure' dll in bin folder of your project and this problem should be resolved. If you have .Net framework installed on machine, this dll should be present on it. You can search for this dll and copy it in your active project folder.   Alternatively,  you can install this dll using nuget package manager PM> Install-Package Microsoft.Web.Infrastructure -Version 1.0.0 Happy coding!!

Dockerize a dotnet core application with SQL connectivity

Before reading this article, I am assuming that you know Docker, Dotnet core and have a dotnet core application which is trying to connect to SQL server. Read how to build aspnet core app, docker and run the docker container. If docker container is running and you are not able to connect to database, this blog should help you fix it.  Prerequisite -  Make sure code is working via running aspnet core locally via visual studio or command line. Port 1433 is opened for connecting to SQL server. Solution If you have Docker file ready, it should somewhat look like below file -  FROM AS build-env WORKDIR /app # Copy csproj and restore as distinct layers COPY /SampleAPI/*.csproj ./ RUN dotnet restore # Copy everything else and build COPY . . WORKDIR /app/SampleAPI RUN dotnet publish -c Production -o publish # Build runtime image FROM WORKDIR /app/SampleAPI COPY --from=build-env /app/SampleAPI . WORK