{
"metadata": {
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.8.3-final"
},
"orig_nbformat": 2,
"kernelspec": {
"name": "python3",
"display_name": "Python 3",
"language": "python"
}
},
"nbformat": 4,
"nbformat_minor": 2,
"cells": [
{
"source": [
"## Pumpkin Pricing Per Bushel, by City\n",
"\n",
"Load up required libraries and dataset. Convert the data to a dataframe containing a subset of the data: \n",
"\n",
"- Only get pumpkins priced by the bushel\n",
"- Convert the date to a month\n",
"- Calculate the price to be an average of high and low prices\n",
"- Convert the price to reflect the pricing by bushel quantity"
],
"cell_type": "markdown",
"metadata": {}
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [
{
"output_type": "execute_result",
"data": {
"text/plain": [
" City Name Type Package Variety Sub Variety Grade Date \\\n",
"0 BALTIMORE NaN 24 inch bins NaN NaN NaN 4/29/17 \n",
"1 BALTIMORE NaN 24 inch bins NaN NaN NaN 5/6/17 \n",
"2 BALTIMORE NaN 24 inch bins HOWDEN TYPE NaN NaN 9/24/16 \n",
"3 BALTIMORE NaN 24 inch bins HOWDEN TYPE NaN NaN 9/24/16 \n",
"4 BALTIMORE NaN 24 inch bins HOWDEN TYPE NaN NaN 11/5/16 \n",
"\n",
" Low Price High Price Mostly Low ... Unit of Sale Quality Condition \\\n",
"0 270.0 280.0 270.0 ... NaN NaN NaN \n",
"1 270.0 280.0 270.0 ... NaN NaN NaN \n",
"2 160.0 160.0 160.0 ... NaN NaN NaN \n",
"3 160.0 160.0 160.0 ... NaN NaN NaN \n",
"4 90.0 100.0 90.0 ... NaN NaN NaN \n",
"\n",
" Appearance Storage Crop Repack Trans Mode Unnamed: 24 Unnamed: 25 \n",
"0 NaN NaN NaN E NaN NaN NaN \n",
"1 NaN NaN NaN E NaN NaN NaN \n",
"2 NaN NaN NaN N NaN NaN NaN \n",
"3 NaN NaN NaN N NaN NaN NaN \n",
"4 NaN NaN NaN N NaN NaN NaN \n",
"\n",
"[5 rows x 26 columns]"
],
"text/html": "
\n\n
\n \n
\n
\n
City Name
\n
Type
\n
Package
\n
Variety
\n
Sub Variety
\n
Grade
\n
Date
\n
Low Price
\n
High Price
\n
Mostly Low
\n
...
\n
Unit of Sale
\n
Quality
\n
Condition
\n
Appearance
\n
Storage
\n
Crop
\n
Repack
\n
Trans Mode
\n
Unnamed: 24
\n
Unnamed: 25
\n
\n \n \n
\n
0
\n
BALTIMORE
\n
NaN
\n
24 inch bins
\n
NaN
\n
NaN
\n
NaN
\n
4/29/17
\n
270.0
\n
280.0
\n
270.0
\n
...
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
E
\n
NaN
\n
NaN
\n
NaN
\n
\n
\n
1
\n
BALTIMORE
\n
NaN
\n
24 inch bins
\n
NaN
\n
NaN
\n
NaN
\n
5/6/17
\n
270.0
\n
280.0
\n
270.0
\n
...
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
E
\n
NaN
\n
NaN
\n
NaN
\n
\n
\n
2
\n
BALTIMORE
\n
NaN
\n
24 inch bins
\n
HOWDEN TYPE
\n
NaN
\n
NaN
\n
9/24/16
\n
160.0
\n
160.0
\n
160.0
\n
...
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
N
\n
NaN
\n
NaN
\n
NaN
\n
\n
\n
3
\n
BALTIMORE
\n
NaN
\n
24 inch bins
\n
HOWDEN TYPE
\n
NaN
\n
NaN
\n
9/24/16
\n
160.0
\n
160.0
\n
160.0
\n
...
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
N
\n
NaN
\n
NaN
\n
NaN
\n
\n
\n
4
\n
BALTIMORE
\n
NaN
\n
24 inch bins
\n
HOWDEN TYPE
\n
NaN
\n
NaN
\n
11/5/16
\n
90.0
\n
100.0
\n
90.0
\n
...
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
NaN
\n
N
\n
NaN
\n
NaN
\n
NaN
\n
\n \n
\n
5 rows × 26 columns
\n
"
},
"metadata": {},
"execution_count": 2
}
],
"source": [
"import pandas as pd\n",
"import matplotlib.pyplot as plt\n",
"import numpy as np\n",
"\n",
"pumpkins = pd.read_csv('../data/US-pumpkins.csv')\n",
"\n",
"pumpkins.head()\n"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {},
"outputs": [
{
"output_type": "execute_result",
"data": {
"text/plain": [
" Month Variety City Package Low Price High Price \\\n",
"70 9 PIE TYPE BALTIMORE 1 1/9 bushel cartons 15.0 15.0 \n",
"71 9 PIE TYPE BALTIMORE 1 1/9 bushel cartons 18.0 18.0 \n",
"72 10 PIE TYPE BALTIMORE 1 1/9 bushel cartons 18.0 18.0 \n",
"73 10 PIE TYPE BALTIMORE 1 1/9 bushel cartons 17.0 17.0 \n",
"74 10 PIE TYPE BALTIMORE 1 1/9 bushel cartons 15.0 15.0 \n",
"\n",
" Price \n",
"70 13.636364 \n",
"71 16.363636 \n",
"72 16.363636 \n",
"73 15.454545 \n",
"74 13.636364 "
],
"text/html": "
\n\n
\n \n
\n
\n
Month
\n
Variety
\n
City
\n
Package
\n
Low Price
\n
High Price
\n
Price
\n
\n \n \n
\n
70
\n
9
\n
PIE TYPE
\n
BALTIMORE
\n
1 1/9 bushel cartons
\n
15.0
\n
15.0
\n
13.636364
\n
\n
\n
71
\n
9
\n
PIE TYPE
\n
BALTIMORE
\n
1 1/9 bushel cartons
\n
18.0
\n
18.0
\n
16.363636
\n
\n
\n
72
\n
10
\n
PIE TYPE
\n
BALTIMORE
\n
1 1/9 bushel cartons
\n
18.0
\n
18.0
\n
16.363636
\n
\n
\n
73
\n
10
\n
PIE TYPE
\n
BALTIMORE
\n
1 1/9 bushel cartons
\n
17.0
\n
17.0
\n
15.454545
\n
\n
\n
74
\n
10
\n
PIE TYPE
\n
BALTIMORE
\n
1 1/9 bushel cartons
\n
15.0
\n
15.0
\n
13.636364
\n
\n \n
\n
"
},
"metadata": {},
"execution_count": 3
}
],
"source": [
"\n",
"pumpkins = pumpkins[pumpkins['Package'].str.contains('bushel', case=True, regex=True)]\n",
"\n",
"new_columns = ['Package', 'Variety', 'City Name', 'Month', 'Low Price', 'High Price', 'Date', 'City Num', 'Variety Num']\n",
"\n",
"\n",
"pumpkins = pumpkins.drop([c for c in pumpkins.columns if c not in new_columns], axis=1)\n",
"\n",
"price = (pumpkins['Low Price'] + pumpkins['High Price']) / 2\n",
"\n",
"month = pd.DatetimeIndex(pumpkins['Date']).month\n",
"\n",
"\n",
"new_pumpkins = pd.DataFrame({'Month': month, 'Variety': pumpkins['Variety'], 'City': pumpkins['City Name'], 'Package': pumpkins['Package'], 'Low Price': pumpkins['Low Price'],'High Price': pumpkins['High Price'], 'Price': price})\n",
"\n",
"new_pumpkins.loc[new_pumpkins['Package'].str.contains('1 1/9'), 'Price'] = price/1.1\n",
"\n",
"new_pumpkins.loc[new_pumpkins['Package'].str.contains('1/2'), 'Price'] = price*2\n",
"\n",
"new_pumpkins.head()\n"
]
},
{
"source": [
"A basic scatterplot reminds us that we only have month data from August through December. We probably need more data to be able to draw conclusions in a linear fashion."
],
"cell_type": "markdown",
"metadata": {}
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {},
"outputs": [
{
"output_type": "execute_result",
"data": {
"text/plain": [
"([0, 1, 2, 3, 4, 5, 6, 7, 8, 9], )"
]
},
"metadata": {},
"execution_count": 4
},
{
"output_type": "display_data",
"data": {
"text/plain": "",
"image/svg+xml": "\n\n\n