Categories
Database Development

Methods for tracking processing time for long running ADD INDEX call in MySQL

I’ve set off index creation on a very large table in MySQL and while I expected it to take a long time, I’m 5 days in and wondering if there’s any way to debug potential issues or simply let it run. I don’t have a precise row count but to estimate, it’s in the 100s […]

Categories
Mastering Development

NameError: name ‘all_df’ is not defined

#!/usr/bin/env python3 # -*- coding: utf-8 -*- “”” Created on Mon Aug 14 2017 Modified on Wed Aug 16 2017 Author: Yanfei Wu Get the past 500 S&P 500 stocks data “”” from bs4 import BeautifulSoup import requests from datetime import datetime import pandas as pd import pandas_datareader.data as web def get_ticker_and_sector(url=’https://en.wikipedia.org/wiki/List_of_S%26P_500_companies’): “”” get the […]

Categories
Database Development

Methods for tracking processing time for long running ADD INDEX call in MySQL

I’ve set off index creation on a very large table in MySQL and while I expected it to take a long time, I’m 5 days in and wondering if there’s any way to debug potential issues or simply let it run. I don’t have a precise row count but to estimate, it’s in the 100s […]

Categories
Mastering Development

How to create visualization from time series data in a .txt file in python

I have a .txt file with three columns: Time, ticker, price. The time is spaced in 15 second intervals. It looks like this uploaded to jupyter notebook and put into a Pandas DF. time ticker price 0 09:30:35 EV 33.860 1 00:00:00 AMG 60.430 2 09:30:35 AMG 60.750 3 00:00:00 BLK 455.350 4 09:30:35 BLK […]

Categories
Development

How to feed a column with a join ? (update join)

I have a dataframe with financials data for an index named S&P500 (date, ticker, price). I have another dataframe with (date, ticker, Action). Action == “IN” when a ticker is added to the index at date Action == “OUT” when a ticker is removed from the index at date And I want to add 2 […]