” 写作MTH 4130程序、 辅导DATA ANALYSIS编程、 辅导Java，Python语言程序BERNARD BARUCH COLLEGEMTH 4130 MATHEMATICS OF DATA ANALYSIS (FALL 2020)FinalThe aim of this take-home final is to illustrate the techniques discussed during the first lecture to predicttemperature as a function of time. The data to be used are historical records of temperatures across the UnitedStates. Data are available on the Noaa website1and we will focus on the Hourly02 directory. The time isspecified by UTC DATE, UTC TIME, LST DATE and the temperature by T HR AVG.Part one. As you can see Data refer to multiple weather stations across the United States. The data set is notconsistent, for some of the stations there are recordings going back to the year 2000 while for some other weatherstations data recording starts later in time. In addition, it may happen that some of the data are missing onlyfor few days of the year or few hours of a given day. We will focus on studying temperature relative to theweather station in Asheville (North Carolina) as a function of time.(1) Plot the data over different time intervals (e.g. one day, one week, and one month) and realize thatthere are periodic variations happening at different time scales. Temperatures variations of night andday cycles happen with a period of 24 hours while there are seasonality variations happening on thetime scale of months.(2) Identify a good set of features (all of them have to be a function of time at this point of the project)to be used with linear regression to describe the time series. Clearly, good candidates for this task areperiodic sine and cosine functions of time with periods that take into account the variations observedat the previous point. Specify wich features you are using.(3) By using linear regrassion, build a first predictive model that is valid only for the month of May. Inorder to do that you can isolate the month of May from each year of the time series and use hourlytemperature relative to that Month only to predict temperatures in May.Blind cross validation does not really make sense in the context of time series. A better idea is totrain your model using all the data except the one referring to the last year available (that should be2020) on which you can test your model. Focusing on the prediction of a given month should makefeatures selection a bit easier since seasonal variations of the temperature should not play such a big role.The more features you use the more the complexity of your model increases. Show the phenomenon ofoverfitting when too many features are included in the model.(4) Try to build a model that Works for the entire year. Now you should include features (again functionsof time) that take into account seasonal variation of the temperature. Include all the data up to 3days before the day/time you want to predict. So if you are predicting the temperature on May 5th at4pm. Use all the temperature available up to May 2 at 4pm. Compare the performances of these twomodels (the one using only data from May and the one using data over all the year) to predict hourlytemperatures during the month of May.(5) Build another model using KNN. Here overfitting happens as you decrease the number of points K usedto compute the local averages used in KNN. Explain how you choose K in this context.(6) How do the linear regression model and KNN compare in terms of predictions?Part two. Include in your model the features as T MAX and T MIN and P CALC. Do they help to predict thetemperature?In addition, in this Part you should analyze your model from the statistical point of view. How manycoefficient are significantly different from zero in your linear regression model? How big is their variance?Part three – optional for extra credits. By looking at the data you may realize that there are temperaturesvariations that are not regular in time. These are weather systems passing over the weather station. They arehard to predict and, for instance, cannot be captured with the linear regression model used at the previouspoint. Come up with a strategy to predict these events for a given weather stations. This strategy should bebased on the information that can be captured from nearby weather stations by considering that a weathersystem over a given region it is likely to move to nearby regions with a pattern that most of the time is regular(from west to east).In this case it is useful to see if there is a correlation between signals of different stations. The correlationanalysis should be Done taking into account times lag of the signals due to the fact that it takes time for aweather system to move from a region to another.1 httpss://www.ncdc.noaa.gov/crn/qcdatasets.html1 https://www.daixie0.com/contents/9/5577.html
“
添加老师微信回复‘’官网 辅导‘’获取专业老师帮助，或点击联系老师1对1在线指导。
