It looks like you're new here. If you want to get involved, click one of these buttons!

- All Categories 2.4K
- Chat 504
- Study Groups 21
- Petri Nets 9
- Epidemiology 4
- Leaf Modeling 2
- Review Sections 9
- MIT 2020: Programming with Categories 51
- MIT 2020: Lectures 20
- MIT 2020: Exercises 25
- Baez ACT 2019: Online Course 339
- Baez ACT 2019: Lectures 79
- Baez ACT 2019: Exercises 149
- Baez ACT 2019: Chat 50
- UCR ACT Seminar 4
- General 75
- Azimuth Code Project 111
- Statistical methods 4
- Drafts 10
- Math Syntax Demos 15
- Wiki - Latest Changes 3
- Strategy 113
- Azimuth Project 1.1K
- - Spam 1
- News and Information 148
- Azimuth Blog 149
- - Conventions and Policies 21
- - Questions 43
- Azimuth Wiki 718

Options

CDF: large every other point

I will post still screenshots of the full data.

You see these 2 humps at the end, they are due to padding, I do not believe they are in the original data, I will fiddle with padding later on.

Generally it is a rectangular volume along time, fairly evenly scattered.

Notes:

- The data had to be normalized for splines to work
- Therefore what you see is the diffeomorphism of the original data (I love to throw in those manifold theory buzzwords, for once something useful came out of all those courses).

D

## Comments

Please see multiple screenshots:

Scatter Plot Laplacian time, screenshots

`Please see multiple screenshots: [Scatter Plot Laplacian time, screenshots](http://files.lossofgenerality.com/scatterplot1.zip)`

Hi Dara. Could you share the raw data as a csv with columns (laplacian, dT/dt, x, y, t)?

thanks Daniel

`Hi Dara. Could you share the raw data as a csv with columns (laplacian, dT/dt, x, y, t)? thanks Daniel`

To include the x, y the volume data is too huge to post online, I could try if you really need x,y . However I got you the list (laplacian, dT/dt, t) which is still large

scatter data 2010

`To include the x, y the volume data is too huge to post online, I could try if you really need x,y . However I got you the list (laplacian, dT/dt, t) which is still large [scatter data 2010](http://files.lossofgenerality.com/scattertest.zip)`

Meanwhile I am making stremplots and posting to youtube, since the actual volumetric data is too large

`Meanwhile I am making stremplots and posting to youtube, since the actual volumetric data is too large`

Hello Daniel

I made the volumetric data sliced thru time and make a video of the Slicer:

Scatter Plot Double

Surface Temperatures 2010

Each streamline vector has x= dT/dt, y=Laplacian

Top plot: Length of the stream vector is proportional to y=Laplacian Bottom plot: Length of the stream vector is proportional to x= dT/dt

`Hello Daniel I made the volumetric data sliced thru time and make a video of the Slicer: [Scatter Plot Double](https://www.youtube.com/watch?v=UxgxWzg6VOg) Surface Temperatures 2010 Each streamline vector has x= dT/dt, y=Laplacian Top plot: Length of the stream vector is proportional to y=Laplacian Bottom plot: Length of the stream vector is proportional to x= dT/dt`

Caveat: the scatter plots and stream line/vectors are approximate and the original data is sparse to start with. So the observed properties (not conclusions) require more investigations

Observations:

ONE. The direction of the (laplacian, dT/dt) is more or less fixed and the stream line vectors kinda vibrate around a fixed directions

TWO. Both coordinates could reach small proportions in comparison to the other

THREE. There seems to be a wave-like propagation perpendicular to direction of stream lines/vectors

Dara

`Caveat: the scatter plots and stream line/vectors are approximate and the original data is sparse to start with. So the observed properties (not conclusions) require more investigations Observations: ONE. The direction of the (laplacian, dT/dt) is more or less fixed and the stream line vectors kinda vibrate around a fixed directions TWO. Both coordinates could reach small proportions in comparison to the other THREE. There seems to be a wave-like propagation perpendicular to direction of stream lines/vectors Dara`

For better quality video

Scatter Plot Double video file

`For better quality video [Scatter Plot Double video file](http://files.lossofgenerality.com/scattersouble.mov)`

Dara, I am trying to get oriented WRT the last scatter plot video.

Is it an altitude cross-section along one zone?

`Dara, I am trying to get oriented WRT the last scatter plot video. Is it an altitude cross-section along one zone?`

No it is a time slice i.e. per day of the year. So imagine the volume grid, slice it each day and then inside each slice plot the 2D vector (laplacian, dT/dt) at each node on the grid. Then vary the length of that vector proportionally by laplacian and then by dT/dt, this way you could visualize the laplacian / (dT/dt) as a quotient, which was what Daniel was concerned about.

`No it is a time slice i.e. per day of the year. So imagine the volume grid, slice it each day and then inside each slice plot the 2D vector (laplacian, dT/dt) at each node on the grid. Then vary the length of that vector proportionally by laplacian and then by dT/dt, this way you could visualize the laplacian / (dT/dt) as a quotient, which was what Daniel was concerned about.`

Dara, Pardon my confusion. Whenever I try to juggle the 4 dimensions of xyz and time together with a metric based on a spatio-temporal derived quantity, I will often will get disoriented.

`Dara, Pardon my confusion. Whenever I try to juggle the 4 dimensions of xyz and time together with a metric based on a spatio-temporal derived quantity, I will often will get disoriented.`

my fault actually need to write you more tools for visualization.

Problem is we are used to 1D and 2D functions and image processing, so when we are given volumetric data find it hard to even start looking at them. It is an educational situation, hopefully John will help us to overcome.

For that matter, I am making these videos and CDFs so we could get use to volumetric data and run the algorithms on volumes vs. 1D or 2D setups.

`my fault actually need to write you more tools for visualization. Problem is we are used to 1D and 2D functions and image processing, so when we are given volumetric data find it hard to even start looking at them. It is an educational situation, hopefully John will help us to overcome. For that matter, I am making these videos and CDFs so we could get use to volumetric data and run the algorithms on volumes vs. 1D or 2D setups.`

Paul I did some visualizations for some slices of time:

vector plot

Stream plot

I don't seem to see any problem in the code. I added the lm linear regression and it is kinda deceptive to come up with a a regression line for this data.

Daniel asked me to take the derivatives on the non-normalized coordinates, I will hack that code tonight sometime.

Dara

`Paul I did some visualizations for some slices of time: [vector plot](http://files.lossofgenerality.com/http:/daniel_debug.pdf) [Stream plot ](http://files.lossofgenerality.com/daniel_debug_stream.pdf) I don't seem to see any problem in the code. I added the lm linear regression and it is kinda deceptive to come up with a a regression line for this data. Daniel asked me to take the derivatives on the non-normalized coordinates, I will hack that code tonight sometime. Dara`

Here is the non-normalized version, it looks a lot more reasonable now. So any scaling or truncation of the numbers might overly simplify the field lines in the streamplots:

Stream Plot Laplacian dT/dt non-normalized

Generally we could have any dimension volumetric data and spline along the axes and take derivatives.

`Here is the non-normalized version, it looks a lot more reasonable now. So any scaling or truncation of the numbers might overly simplify the field lines in the streamplots: [Stream Plot Laplacian dT/dt non-normalized ](http://files.lossofgenerality.com/daniel_debug_stream2.pdf) Generally we could have any dimension volumetric data and spline along the axes and take derivatives.`

This is the meta data for the data:

{"Conventions" -> "COARDS", "title" -> "mean daily NMC reanalysis (2010)", "history" -> "created 2009/12 by Hoop (netCDF2.3)", "description" -> "Data is from NMC initialized reanalysis (4x/day). These are the 0.9950 sigma level values.", "platform" -> "Model", "references" -> "http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis.\ html"}

`This is the meta data for the data: {"Conventions" -> "COARDS", "title" -> "mean daily NMC reanalysis (2010)", "history" -> "created 2009/12 by Hoop (netCDF2.3)", "description" -> "Data is from NMC initialized reanalysis (4x/day). These are the 0.9950 sigma level values.", "platform" -> "Model", "references" -> "http://www.esrl.noaa.gov/psd/data/gridded/data.ncep.reanalysis.\ html"}`

Dara, This is hot off the press

"Quasi-resonant circulation regimes and hemispheric synchronization of extreme weather in boreal summer" http://www.pnas.org/content/early/2014/08/06/1412797111.abstract

They say

Then

Interesting the mention of waveguides.

`Dara, This is hot off the press "Quasi-resonant circulation regimes and hemispheric synchronization of extreme weather in boreal summer" <http://www.pnas.org/content/early/2014/08/06/1412797111.abstract> They say "Two mechanisms have recently been proposed that could provoke such patterns: (i) a weakening of the zonal mean jets and (ii) an amplification of quasi-stationary waves by resonance between free and forced waves in midlatitude waveguides." Then "The spread in the zonal mean zonal wind reflects,in the first place, the seasonal cycle with weaker jets and hence slower wave propagation in summertime. Therefore, in boreal summer, a significant fraction of synoptic waves, notably with k = 6, have a phase speed close to zero (quasi-stationary) or are even traveling westward." Interesting the mention of waveguides.`

Dara, regarding your question on Figure 3 and 4 in the Boreal Summer paper above, they might be looking at dispersion of wind velocities at altitude.

I did some perhaps related analysis of this a few years ago based on high resolution data collected by airplanes flying at altitude.

http://theoilconundrum.blogspot.com/2013/03/spatial-and-temporal-correlations-of.html

It is hard to get a handle on the spatial and temporal scale involved since these effects can occur at so many scales.

`Dara, regarding your question on Figure 3 and 4 in the Boreal Summer paper above, they might be looking at dispersion of wind velocities at altitude. I did some perhaps related analysis of this a few years ago based on high resolution data collected by airplanes flying at altitude. <http://theoilconundrum.blogspot.com/2013/03/spatial-and-temporal-correlations-of.html> It is hard to get a handle on the spatial and temporal scale involved since these effects can occur at so many scales.`