There are good websites which store a lot of pdf files that can be used for data. However, it can be quite difficult to automate the downloading process with a simple web scraping tool because the data download url that the user wants resides behind another webpage. I will use IMF website for example.
(more…)I am running my wordpress in aws and recently my wordpress dashboard was giving my warnings to update php version from 7.2 to 7.4 for security. Updating php version I am currently using Ubuntu 18.04 version. This Ubuntu version doesn’t natively support php 7.4. So the following commands were required Read more…
I was stuck with directly downloading a large google drive file(dataset file) to my server which was headless and thus I was forced to use the terminal. However, I could not download google drive link with wget since even in a browser it cannot by pass the virus check ignore Read more…
Situation I am querying with apollo client to fetch some userinfo. From the server side which uses apollo server, I can check that it is returning an array of two items which have different contents. However, when I console the fetched data from apollo client, the array is somehow incorrect. Read more…
Problem My django project structure looks like this.(only showing files relevant to this problem) As you can see, there are two static dirs that has to be served: ‘prj/app/static/and ‘prj/static. When serving this project from the root of a domain such as ‘localhost:8000’, the following configuration for static files in Read more…
npm install commands add babel.config.json add webpack.config.js
unfortunately there isn’t any native way to get formatted timestamp. Here is a script that does the job. this will output YYMMDD_HHMMSS format timestamp
Problem I had a react project that was originally worked in windows environment. I migrated to ubuntu environment and attempted to start project with webpack-dev-server. After installing all npm packages, I encoured the following error Solution This was caused because of my webpack-dev-server open config. Here is the devserver config Read more…
webpack-dev-server is a wonderful tool when developing due to live reloading features when working on react projects. However, a complication arises when the user begins to add data serving apis. By default, webpack-dev-server only serves the front-end related files when started, which leaves no room for the user to squash Read more…