[CODEBASE] How to import a 7.000.000-row dataset into SQL

STEP #1: CREATE TABLE

CREATE TABLE flight_delays (
  year INTEGER,
  month INTEGER,
  dayofmonth INTEGER,
  dayofweek INTEGER,
  deptime INTEGER,
  arrtime INTEGER,
  flightnum INTEGER,
  tailnum VARCHAR,
  airtime INTEGER,
  arrdelay INTEGER,
  depdelay INTEGER,
  origin VARCHAR,
  dest VARCHAR,
  distance INTEGER);

STEP #2: COPY THE DATA

COPY flight_delays
FROM PROGRAM 'wget -qO- https://course.data36.com/sql_practicing.csv'
DELIMITER ',' CSV HEADER;

STEP #3: COMMIT

COMMIT;

STEP #4: ENJOY 🙂

SELECT * FROM flight_delays LIMIT 10;

FULL VIDEO

LINKS MENTIONED

• Longer, more detailed server installation guide (with Python, pandas, SQL, R, etc.)
• SQL Workbench installation tutorial
• SQL tutorial series
• SQL tutorial videos on Youtube
• 7-day SQL course
• Newsletter (+ SQL cheat sheet access)

---

• If you want to learn more about how to become a data scientist, take my 50-minute video course: How to Become a Data Scientist. (It’s free!)
• Also check out my 6-week online course: The Junior Data Scientist’s First Month video course.

Cheers,
Tomi Mester

Cheers,
Tomi Mester