avatar

Yi Qiu

Ph.D. student in Physics Department of Pennsylvania State University.

3-21

Informed by Alex I was selected!!!

3-29

First email from Xisco--ask about availability.

4-7

First email talk with Pierre.:)

I was sent recommended papers to read in advance from both of them.

https://arxiv.org/abs/1903.08284

https://arxiv.org/abs/1905.00869

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5253841/pdf/41114_2016_Article_2.pdf

https://arxiv.org/pdf/gr-qc/0309007.pdf

https://arxiv.org/pdf/gr-qc/0309007.pdf

https://arxiv.org/pdf/1910.08708.pdf

5-11

First meet with Xisco and Pierre :)

Short discussion + 3 projects for training.

6-21

Q1

Why choose the start time to be 2.3M?

Try to plot the difference between

Q2

Why does the oscillation of alpha/beta1 fitting happen?

try to include with early time data

Q3

Why was the estimation of spin is worse than the mass's?

l=2 m=2 mode

Xisco's paper in 2015

6-28

What had I done last week?

  • Plot the difference (relative/absolute deviation) between model with different fit starting time on every point. (With Dhruv's help)

    try higher overtones

  • Try with another list of estimation parameters and compare them with Xisco's. (one magnitude above with data from Python qnm)

  • Try to extract mass and spin from \(\alpha_0\) and \(\beta_0\)

Question?

  1. What's the quality of different qnm results (calculate in different ways)

Use the 2,0 mode!!!

Try also compare the Berti's table of Qnm

  1. What's the meaning of the estimation from \(\alpha_0\) and \(\beta_0\) to MASS and SPIN?

    To what extent should fundamental tone model be modified by alpha and beta, and how it can be done by comparing the two estimation.

7-5

  1. Talk about alpha and beta
  • try with other fitting model
  • fits higher overtones
  1. GWdata have 200 mode?

  2. NRdata have other spin mass or m unequal 0 mode?

    PROBABLY IN PROGRESS

7-6

Yesterday's presentation is a good experience for me, I found that I am still vague to a lot of knowledge related to my work. Actually, this could be a serious problem! Xisco and Pierre, they are very nice, they give me some advices and now I decided to ask more questions and keep a working dairy like this everyday.

Q1: maximum electric charge of final black hole after merger that has been detected so far?

7-12

What have I done for the last week?

  • Try to find a better model.
  • Try to modify the computation from QNM to BH's mass and spin with alpha0 and beta0 in higher overtone models.
  • Spend some time to understand the shear modes.

Results

  • Found a rational model that seemed better.
  • Maybe the alphas and betas are really needed for such computation.

Question?

  1. Why were the fitting results different?
  2. Maximum electric charge of final black hole after merger that has been detected so far?

Plan

  1. Try to find the model from the wave equation.
  2. Connect to Atlas and try with even higher overtones.
  3. Reading papers!

7-14

  1. Discuss about the fit.
  2. Show the markdown version of potential presentation next week.
  3. Talk about plans and todolist for this week.

7-19

  1. Discuss about the fit.

  2. Question:

    • Why are the alpha&betas still unstable when using the higher overtones?

    • Should I change to another language/method (like Scipy) and see the fitting results of them?

      • Modify the fit still in Mathematica.

      • Gwnrdata mass=0.952032939704, spin=0.692085186818.

      • Error bar.

7-23

  1. Talk about the results. Using constraints in the fit.

    • try to use negative fit starting time.

    • error bar plot.

    • omega, 1/tau as functions of spin (mass=1). (remember to divide by mass)

      omega(m,a) = omega(m=1,a)/m,

      tau(m,a) = m/(oneOverTau(m=1,a).

7-29

  1. Questions about the data requirement for Pierre's code. Ask about whether I should re-run the same code.

    sxsdir="/Users/xisco/SXS/SXS_New"; ritdir="/Users/xisco/RIT"; seldirs="~/Desktop/RDFits/sxsdirs.dat";

    mysxscasemetafile=FileNames["metadata.json",mysxscase,2][[1]] ==metadata===Import[mysxscasemetafile]; ==h5file===FileNames["rhOverM",mysxscase,2]

  2. Work in progress:

    Fitting alpha, beta——tested for some days, track the fitting and try to improve.

    Introduce

  3. About the preprint paper (if still have time).

    • Why was local discrepancy so small?
    • Is the radiation error come from SXS data production process?
  4. About how to read arXiv daily (if still have time).

8-2

  1. Questions:
    • The gwnr data before t=0?
    • What to do when mass/spin hit an edge?
    • Why can't the .m code work?
    • How to speed up the fitringdowngrid function?
    • In different n_max model, see the t-epsilon plot.
    • Try set the alpha and beta instead of fitting them. 10%-20%.
1
ssh condor1.atlas.aei.uni-hannover.de

scp -r condor1.atlas.aei.uni-hannover.de:/work/francisco.jimenez/SXS/data/SXS_BBH_0305 /Users/qe/downloads/RDownData

Host atlas1 atlas2 atlas3 atlas4 condor1 condor2 condor3 condor4 condor5 condor6 condor7 condor8 condor9 condorp condori Hostname %h.atlas.aei.uni-hannover.de IdentitiesOnly yes IdentityFile ~/.ssh/id_ed25519-atlas User pierre.mourier ServerAliveInterval 60 ServerAliveCountMax 5

8-6

  1. Results:
    • Alpha/Betas may be highly correlated with mass/spin.
    • T-epsilon plot.
  2. Keep in mind
    • Massrange-low-like 1.3. Follow the rule Xisco sent in main zoom chat.
    • {0.2,1.2} for nmax=3.
    • Complex data.

8-9

  1. Results:

    • t-epsilon plot.
  2. Questions:

    • Is there any other dataset?
  3. to do

    • try to plot both real and complex t-epsilon.

    • try with higher overtones for setting alpha and beta manually.

8-11

  1. Ideas:
    • Fit for the last alpha and beta.
    • Slope/relative deviation (epsilon-deviation)-nmax plot?
    • Mismatch plot of modifying the highest tones.
    • Extend the deviation range of pp cases (500%).
    • Try with (0,p), (p,0) ...
      • Try with another mass ratio data.
  2. Submit jobs:
    • scp /Users/qe/Downloads/overtones-project_Yi/codes/RdownCode/qnmdataint.mx condor1.atlas.aei.uni-hannover.de:/work/yi.qiu/Overtone/job8-25
    • scp -r condor4.atlas.aei.uni-hannover.de:/work/yi.qiu/Overtone/job8-12/result1 /Users/qe/Desktop
    • condor_submit condor_submit_test1.sub

8-13

  1. Results
    • Fit for the last alpha and beta.
    • Extend the range of deviation & add p0, 0p... cases.
    • Mismatch plot of modifying the highest tones.
  2. Suggestions?
    • ReIm option, adding the calculation of covariance matrix in the function CNMinizer.
    • Try with just the real part and see their parameter table (attempt 1).
    • Extract the amplitude out of the fitringdowngrid function.
    • Logscale the mismatch.
    • Set alpha0 &beta0 (alpha1 &beta1) to be free, and fit for n-(0,7).

8-14

Submit jobs:

  • scp condor4.atlas.aei.uni-hannover.de:/work/yi.qiu/Overtone/job8-17/epstable0iter7.wdx /Users/qe/Desktop
  • condor_submit condor_submit_test1.sub
  • condor_q

8-16

  1. Problem
    • New .m package conflicts with the old one.
    • Which algorithms to use?
  2. Plans for next steps
    • To make the contourplot for the epsilons. (Keep all the warnings.)
    • Amplitude evolution with the alpha & betas.(Plus-Plus)
    • Set alpha0 &beta0 (alpha1 &beta1(separately and together)) to be free, and fit for n-(0,7).
    • Logscale
    • 1/cosh(t/tau)

8-17

  • source /work/dhruv.sharma/py3env_1/bin/activate
  • scp -r condor4.atlas.aei.uni-hannover.de:/work/yi.qiu/Overtone/job8-25 /Users/qe/Desktop/perturbed/result
  • "Executable"->"/work/dhruv.sharma/py3env_1/bin/python"
  • condor_submit condor_submit_test1.sub

8-18

  • Try to copy the local interpolation file to the Atlas.
  • Globally transform the time coordinate.
  • Set different initial point.
  • Presentation:
    1. overtone model —> plots on epsilon.
    2. overtone model with alpha and beta—> plots on epsilon.
    3. perturbed overtone model —> plots on epsilon.

8-20

Questions:

  1. Which original models should we compare with the modified ones?
  2. Modify only the loweat (fundamental) tone, and see the evolution of the modified values with the nmax, then combine the results with the highest tone modification to give an overall stability measurement?

Suggest:

  1. Add the 0,1 tone case to all the researches.
  2. Change the interval/step.
  3. Compare between the adding best alpha/beta with n+1 modified model.

8-23

  1. Questions
    • Why is the ringdown part of the template waveform (like what Yifan showed last week) dieviating from the theoretical damped-sin wave so much?
    • A1: The waveform was generated in a perturbed (non-GR) theory.
    • A2: There are cutoffs used in the frequency-spectrum, which would affect the form of high mass BBHs event.
  2. To do list
    • Adding constraints to the FindMinimum[{x Cos[x], 1 <= x <= 15}, {x, 7}].
    • Compile the functions
  3. Simran's pre
    • What is the valid-with the known parameters.
    • First step is signal alarm-which can give a time slice sample, then we can do whether match flitering or machine learning.
    • After building the network, we compare the loss function of training dataset and validaiton dataset, to see if the loss is truly decresing with the iterations or the model is just overfitting.

8-25

  1. Things to add in the appendix:https://www.its.caltech.edu/~kip/PubScans/II-175.pdf.
  2. Results:
  • Both compile and adding constaints to the findminimun function seemed to significantly increase the running time. (about factor of 5~10)
  • Found a way to do nonlinearmodelfit with complex ansatz.
  • Plot part of the results.

Questions:

  • How to have median/standard deviation of epsilon and plot the error bar?
  • What does one iteration mean in Mathematica, and how does it work with the constraints?
  • What to do if the job is held in Atlas?

Todo:

  • The same plot with mismatch of each models.
  • epsilon-mismatch in log-log scale.
  • Extend the analysis to N=10.
  • Try with the output I already have to plot the error bar.
  • Condor is one of the cluster mannagers. Linux program. ==sbatch==.

8-31

  1. Questions:
    • Do we only need to consider the tones that have its mismatch above the NR errors (10^(-5))? Like a 4 overtone model?
  2. To do:
    • Try to add the error bar to the alpha and beta.
    • tone0 + tone1 with a1,b1 vs. tone0 + tone1 + tone2 vs. tone0 + tone1 + xp t^gamma vs. ...
    • in the grid of the alpha and beta-{-0.2,0.2 -0.5,0.5}, to refine the step and search for high resolution alpha/beta. (for n=0)

9-3

  1. Schedule for 45 mins:

    • 10min~15min discuss about yesterday's argument.
    • 5min draw a conclusion about it.
    • 15min discuss about other 2 results of last time suggestions.
    • 10~15min about paper writting.
  2. To be discussed

    • Fix the initial value of alpha and beta to be zero in the second approach.

    • To extend the mismatch approach of abgrid to 7 tones.

    • averaging alpha/beta square. sqrt(_{i=1...N}(xi) / N)

    • What potentially can i write down for now?

      • Other modified models.
      • Spectroscopy parameter estimation.
      • Thinking first.

9-11

  1. Get the highest tone modified models' alpha/beta values of several waveform data generated by different pairs of mass/spin.
  2. ==Pairwise Plot==
  3. ASK if he will be in HK.

9-14

  1. Content/(TimeTable):

    • mismatch results to N=7. (~5min)

    • Comparison with the epsilon approach. (~15min)

    • Perturbing each tone in N=6 model. (~5min)

    • Modified models' results. (~10min)

    • Fit starting time. (~5min)

  2. To do:

    • Band width? (In order to clearly show the distribution)
    • Pair plots of 0,1 tone all perturbed.
    • Extend the tone analysis to 1-5 overtone model.

Suggestions:

  • Extend the range of mismatch approach.
  • Time coordinate transformation model.
  • To use the square of alpha/beta.
  • Looking for the important.
  • Create a repository.

9-22

  1. New results:
    • Pair grid plot (Incorrect).
    • Extension of alpha_N/beta_N grid range.
    • Tone comparison.
  2. About the preparation of paper draft:
    • Github repository.
    • Overleaf project: organization of the current results. Discuss the train of thoughts.
  3. Questions:
    • Should we test the fitting which we set the mass/spin as freee parameters as an extra explanation of why we use the fitringdowngrid?
  4. Todo list:
    • Distribution property of mismatch and epsilon in the alpha/beta grid.
    • Correct the 0,1 tones model.
    • To add the reference lines for the tone comparison plot.
    • Try to accelarate the codes:
      • TakeColumn[data, 2].
      • ToExpression["A"]->0?
      • Maxiteration.
      • Try to test some other mass/spin.
    • To explain the mismatch-epsilon plot.
    • To do 0,1 modification to other Nmax.
    • Recover the 1D version of alpha/beta grid.

10-1

  1. Issues and results to discuss:

    • How to extract the \(\sigma\) correctly?
    • 0/1 tones modification.
    • Overflows occurred in time coordinate transformation models.
    • Paper draft: most of the plots and structure (sections/subsec./subsubsec...).
  2. Suggestions

    • Try the exponential form of mis.

    • corner.py

    • fg=corner.corner(postsamps,quantiles=[0.05,0.5,0.95],show_titles=True,max_n_ticks = 4,bins=50,labels=labels,truth_color='red')

      plt.show() if export: fg.savefig(corner_plot, format = 'png', bbox_inches = 'tight')

    • CNMinimize[RDdata[[All, 2]], ans1tTan, pars, {t, RDdata[[All, 1]]}, "Bounds" -> {6 <= tp <= 20, 0 <= [Sigma] <= 100}, Method -> "NelderMead", MaxIterations -> 100000]

10.3

List:

  1. Intro倒数第二段加入errorness,可能的未发现其他tone的原因。
  2. intro最后一段修改
  3. II add summary of analysis.
  4. add subsec about mass/spin grid alpha/beta grid.
  5. IV B some people argued about using diff...
  6. V A 讨论两张图,并写明白为什么要研究highest tone。
  7. V B 每个subsubsec加入motivation以及转场语。
  8. V C discuss about the results.
  9. 0,1 tone perturbed subsec + 2 paras, and comparison between other works.
  10. V E add motivation para.
  11. V E add fig + discussion
  12. VI 1 para summarize.
  13. VI add para discuss about conclusions.
  14. VI last about prospects.
  15. Acknowledge + all summer intern members.

10-6

  1. New results:
    • TCTM.
    • 0, 1 tone jointplot.
  2. Problems:
    • Interpolation of 5D data.
    • Using which SNR is more realistic?
  3. Paper draft:
    • How to proceed?
  4. Suggestion:
    • To compare the modified models with the same number of free parameters.
    • Try to use the SNR of the GW150914, and give the 90% credible contour.
    • datared = Select[test1[[All, {1, 2, 3, 4, 5}]], -0.3001 < #[[3]] < -0.099 &]; datared = Complement[test1[[All, {1, 2, 3, 4, 5}]], datared]; test = Interpolation[datared]

10-10

Writings:

  1. Read about other's first section.
  2. choose the equations.
  3. Write down the paragraphes.
  4. modified accordingly the sub/sec labels.

10-13

  1. Progress:
    • Pairplot.
    • credible interval in progress...
  2. Suggestions:
    • (> 50, e.g. 100, 300, 1000) SNRs in addition, since the numerical data has an "SNR" (data to numerical error ratio really). that is at least of the order of 10^3.
    • Try 1000000 samples in the corner plot.
    • To gather all the plots i made in the summer.
    • Cite Dhruv's paper.
  3. Plan:
    • Writings:
      1. Focusing on the results section.
      2. Modify the plots.
      3. Read the references. (not so important for now)
      4. Firstly review one paragragh 3-4 times.

10-18

In one dimension the probability of finding a sample of the normal distribution in the interval \(\mu \pm \sigma\) is approximately \(68.27 \%\), but in higher dimensions the probability of finding a sample in the region of the standard deviation ellipse is lower.

Dimensionality Probability
1 0.6827
2 0.3935
3 0.1987
4 0.0902
5 0.0374
6 0.0144
7 0.0052
8 0.0018
9 0.0006
10 0.0002

Plan:

  1. Making and modifying plots in one hour per image, then add the discussions in paper for 1-1.5 hours per image. Totally 20-25 hours expected.
  2. Reexaming the logic flow in texts for ~5 hours.

11-2

Questions:

  1. How to calculate the error on epsilon and mismatch?
  2. In the TCTM comparison, we should consider n-1 or n tones? What do we want to present through the results of these?

11-5

Reports:

  1. Functions found in Isi's package:

    https://github.com/maxisi/ringdown/blob/main/ringdown/kde_contour.py

    which can make contours simply with percentages.

  2. Corner package plot.

    • Have more data points involved.

    • Plot the distribution functions as well, and combine them with the sample corner plot.

    • https://emcee.readthedocs.io/en/stable/tutorials/line/

      nwalkers = 300 npoints = 1000 burning = 800

  3. Modifications to plots.

    • t_0/M.
    • do not keep the label above the plots.
    • Makes the texts larger.

Questions:

  1. Can I cite the error values on epsilon and mismatch for SXS data alone from your paper?

    • read the plot.
  2. For the TCTM cases, should we consider n-1 or n tones? What do we want to present through the results of these?

  3. Anything new can be added from the previous plots?

  4. Using the corner package results for different SNR cases (or display them only in the appendix)?

    https://stackoverflow.com/questions/60877259/plot-multiple-datasets-in-the-same-corner-plot

  5. Anything new from arxiv that are highly related to our works?

TO DO:

Ask Alex.

https://imprs-gw.aei.mpg.de/potsdam

11-16

  1. MCMC sampling.

    sigma ~ 1/rho.

    use SNR

  2. Bibgraphy problem.

    Inspirehep_cite.

  3. Draft of paper.

11-17

paper:

  1. modify the bibliography.
  2. Edit the introduction.
  3. add the 0, 1 tone perturbed part.
  4. Add the funda tone part.
  5. edit the conclusions.
  6. Read through all of them and find the place missing cites.
  7. edit the abstract and all the logic.
  8. compare between mine with other papers, check the language usages.
  9. Further adding some reference.
  10. Add the ringdown intro part.

Discussion with Xisco:

  1. To check the chain results are stable.
  2. To try to get the same results for the same snr with both emcee and dynesty. (from high snr first.)
  3. To recover dynesty results with differentnlives.

11-18

  • To add the amplitude and phase to the interpolation list.

    Arg[], Abs[]

  • To run them with parallelization in atlas.

11-24

  1. Sampling options need to be modified, otherwise too slow.
截屏2021-11-24 下午12.41.07
  1. Amplitude/phase also as interpolation objects, they would represent the explanation to the upper limit of deviations we set.

    To use the posterior samples as the input of interpolation fucntion to make the scatter plot of amplitude.

11-26

  1. Cornerplot.
  2. Potential appendix (amplitude checks.)

Application:

  1. Make sure about the deadlines for letters.
  2. Check the specific letter requirements.

12-9

  1. Abstract:

    • Anything inappropriate?
  2. Introduction:

    • Issue: some parts remained copies from your paper :(
    • Should I delete them all and add something I understand for now, or should I just try to rewrite them by browsing through references and summarized them with my own languages?
    • Suggestion: Write my own words.
  3. Conclusion:

    • Should I include some quantified explanations about details in each figure as you did or should I just conclude some important "overviews" in points?
    • Add only the important quantities.
    • The conclusions in points is small and lack explanations in details. Add more explanation.
    • Any advice about the structure?
    • We need to have an agreement first.

1-17

  1. Use matplotlib to improve the Fig. 13457.
  2. Modify the introduction.
  3. Modify the abstract.
  4. Fundamental tone evolution.

ideas

  1. Do the amplitude tests.
  2. look further into the inconsistency between mismatch and epsilon analysis.

1-20

Ideas

  1. Show the amplitude test in part of the paper.

  2. Look deeper into the inconsistency between mismatch and epsilon analysis.

    Q: Should we replace the lowest mismatch by lowest epsilon in the contour plot? And also, the sampling could also be done based on the epsilon results in grid.

Plan

  1. Make the contour plots (and some other plots as well) with matplotlib.
  2. Modify the conclusion section.
  3. To make the contour plot based on the epsilon. N=1, 3. (to make 1,2,3,4,5...if fast enough)

Notes

  1. Numerical black hole spectroscopy.
  2. Xisco's phd and postdoc institute:
    • Balearic Island University.
    • University of Rome.
    • Leiden University.
    • Badri Krishnan.
    • Bohr Institute of Copenhagen University.
    • Alex.

1-21

  1. Problem:
    • The modified overtone models are fitted to the data by varying mass and spin first, and.
  2. Suggestion:
    • Reference lines or cross symbol.
    • Compare the contour of tctm with tone perturbed model at Nmax=3.
    • Nmax=1.

1-25

  1. Results discussion/suggestions:
    • Try higher SNR.
    • Try to compute the Bayes factor
      • Log[evidence_model]-Log[evidence_OM]
      • Log[evidence] = result.logz
      • Check the source code of seaborn kde plot level.
  2. Cut down the paper: 2 plots about the tone perturbed models. 1 plot on model comparison. 1 plot on sampling results. (1 plot on TCTM parameter evolution)

2-1

1. \(N_{max}\) \(\log_{10} \mathcal{B}^{50}_{TCTM-OM}\) \(\log_{10} \mathcal{B}^{50}_{HTPM-OM}\) \(\log_{10} \mathcal{B}^{1000}_{TCTM-OM}\) \(\log_{10} \mathcal{B}^{1000}_{HTPM-OM}\) \(N_{max}\) \(BIC_{TCTM}\) \(BIC_{OM}\)
1 \(0.14\pm0.05\) \(N/A\) \(-109\pm0.09\) \(N/A\) 1 54.2 52.9 \(N/A\)
2 \(1.56\pm0.04\) \(0.36\pm0.05\) \(254\pm0.08\) \(19.9\pm0.08\) 2 44.3 47.2 47.0
3 \(0.67\pm0.03\) \(0.16\pm0.04\) \(39.0\pm0.08\) \(28.6\pm0.08\) 3 58.6 59.1 58.7
4 \(0.88\pm0.02\) \(0.86\pm0.02\) \(5.99\pm0.07\) \(5.17\pm0.07\) 4 73.3 73.3 73.3
5 \(0.74\pm0.02\) \(N/A\) \(1.23\pm0.06\) \(N/A\) 5 87.9 87.9 \(N/A\)
6 \(0.66\pm0.02\) \(N/A\) \(1.00\pm0.06\) \(N/A\) 6 102.6 102.6 \(N/A\)
  1. Discussion/Suggestions:
    • Compute the BIC.
    • Try to cross-check the contours with corner.corner.
    • ==Calculate with lower mass bounds (constant for all model having different tones).==
    • Sampling with other perturbation parameters.

2-9

  1. New table (4-pars):
\(N_{max}\) \(BIC_{TCTM}\) \(BIC_{OM}\) \(BIC_{HTPM}\)
1 -9135.45 -9203.41 -5938.24
2 -14517.6 -12194.2 -12274.7
3 -15270.6 -15103.0 -16887.3
4 -21515.4 -18039.2 -20146.7
5 -20934.6 -20948.2 -20855.9
6 -18896.5 -23197.2 -22197.5
  1. Suggestions:

    • Check the 4-pars mass-spin distribution.

    • Check the BIC and Bayes factor trends the same or not (OM-others).

    • Improve the corner plot pipeline.

    • Try the larger range for the grids computations.

    • Try to find what is the main factor slowing down the sampling.

    •     interp = LinearNDInterpolator(list(zip(w, u, x, y)), z)
          def mis(a,b,c,d):  
              result = interp(a,b,c,d)
              return result
      
          mis = LinearNDInterpolator(...)

2-10

Test the speed of sampling within by changing some options to default, I found that: 1. The number of initial live-points could possibly be proportional to the runtime. 2. The 'multi' bound option of dynesty would be ~2 times faster than 'single' bound of prior, while the 'none' bound condition would be >20 times slower than the 'single' bound.

Testing whether the interpolation is done everytime we sample or not, found that mis = LinearNDInterpolator(...) won't work, and the interpolation would always done just once.

2-23

Here are two plots showing the trend of model comparison (with both BIC and Bayes factor) in regard to Nmax as Xisco suggested. All the sampling are still done with the "mixed" as named by Pierre :) And as you taught me, the BIC would probably agree better with higher SNR cases since the contours would shrink to the limit and pin down on the optimal values of the whole parameter space, so as they getting closer to the way BIC is calculated.

SNR

The \(\log_{10}\) Bayes factors of TCTM vs OM are plot above, while the BICs of OM-TCTM are plotted below.

Untitled

From the two plots, we can tell that:

  1. For the Nmax=0 case (Nmax=1 for the OM), with low SNR, the Bayes factors are, even though small, still larger than 0, which indicate that TCTM would be better. While for the SNR started from 100 to 1000 or above, the Nmax=0 case would have a negative Bayes factor.
  2. For the Nmax=1, 2, 3, the TCTM are clearly better.
  3. BIC plot would agree with the Bayes factors in they are both positive for Nmax=1, 2, 3 (though the trend from 1 to 2 is different), but be different from low SNR case in Nmax=0.

In conclusion, since we could only correctly obtain Bayes factor for the realistic data analysis , with current SNR (typically less than 50), we may probably say TCTM is better. But with future detector like LISA, we may identify the real case here for the Nmax=0 model.

On the other hand, combining evidence found in those modified OMs allowing for QNM bias (like our HTPM), in which the damping time bias would be typically larger than frequency bias, all the facts just point to the problem exist in the time coordinate biases of ringdown signals. Would there be any degeneracy among each modification? Or, would there be some deeper mechanism of nonlinearity to be unveil? We may leave them for following works (like done on real data) to find out.

2-25

  1. Discussions/Suggestions:
    • Try to find the pre-defiend function for linear fitting in python.
    • Try to make the fundamental tone OM as reference for the Bayes factor plots.
    • Add the HTPM as well.
  2. Advice for Master degrees application in EU.
    • Send a reminder to Badri.
    • Ask again.
    • Email to ENS ask about which year should I apply.

3-2

  1. Update Xisco:
    • Bayes factor/BIC plots and the resulting argument.
    • Full-sampling code.
    • Last discussion of me and Pierre on the relevant contents in the draft.
  2. My plan:
    • ==Run 6-pars full-sampling for the OM1-TCTM0 cases.==
    • Check other waveform data for a cross-check.
  3. Suggestions:
    • Two curves for the OM0 reference plot.
    • TCTM, HTPM, OM, EM.
    • Mass/spin contours of different models (for the OM1).
    • Test the 4-pars and 2-pars sampling on the bayes factor.
    • Try to test the flexibility of the full-ringdown OM.

3-9

  1. Updates:
    • Full-sampling results (one example).
    • Using OM0 as reference.
    • 4pars vs 2pars.
    • OM0-TCTM1 mass/spin contours.
  2. Questions:
    • Sampling priors on the amplitudes?
  3. Suggestions:
    • Modify the mismatch by chi square.
    • Combine the code in one file.
    • Change all the axis and label of the plots to label exactly the tone of OM (not TCTM).
    • Add the '\(Log_{10}\)' to every y captions.
    • Try to obtain all the results with the new version of likelihood.
    • [0, 5] for amplitude. work in a amplitude-phase form.

3-23

  1. Time consumed:

    OM-2amp OM-amp-phase TCTM Boundary(double)
    20min-50min 100h+ 10h+ ~\(2\times\)
  2. Issues:

    • Mass-spin contour and suitable priors.
  3. Suggestions:

    • Try to pre-compute the data.sum().

    • Try to remove the periodic-option.

    • if spin<0: qnmspec=QNM_spectrum(2,-2,0,mf_sel[i],-spin) if spin<0 —> m —> -m —> abs(spin) spin negative m->-m —> omega spin positive mirror -> -omega m—>m

    • af = L + S1 + S2 L~ v * r S1 ~v1*RS

      S1 ~ -c RS, S2 ~-c RS L ~ v *r - 2 c RS colision r> 2RS r ~3 RS v ~ c

      Final af= +c RS

    • normally not negative space, but

3-27

Reports:

  1. Log_probablity is needed if we want a hard bounding.
  2. Option "periodic" is only working for the sampling efficiency, so we'd better modify the prior afterward according to it.

3-30

  1. New results and runtime show.

  2. Issues:

    • TCTM double peaks.
    • Fix the prior ranges of both model for final version.
  3. f1 = h5py.File(file,'r') wt = np.exp(f1['samples/logwt'] - f1.attrs.get('log_evidence')) weights = wt/np.sum(wt)

    sampler_dyn.logwt

    f1['samples/logwt’]—>sampler_dyn.logwt

  4. Mass: [, 1.6].

  5. Upload the code to github and share it to Xisco.

4-6

  1. Suggestions:
    • Check the full-sampling is consistent with the 2-para. sampling.
    • Use the -1 scenario for TCTM time scaling.
    • Set A and A0(restricting properly -2 to 2) to be log-prior but keep tau prior to be flat.

4-20

  1. Updates/chats
    • Log_flat prior for A+A0 or only A.
  2. Current jobs:
    • Testing other datasets.
    • Real data?
  3. Other Suggestions:
    • Try with more live points.

5-4

  1. Updates:

    • Priors fixed for BBH:0305.
    • New data test.
  2. Questions/Suggestions:

    • Scri reading?
      • Try with python3 -m conda update -y --all.
      • I should try firstly find my h5py back.
      • Try with current catalog BBH:1221, (BBH:1222)
    • Plan for writing the paper?
      • Try to collect all the results (just figures, no text required, overview no need to be comprehensive) before our next meet.

5-11

  1. Results update:

    • Test results for samplings with more livepoints and walkers.
    • Test results for three waveforms (mass ratio, spin): 0300 (8.5, 0), ==0150== (1, 0.2), ==0305== (1.221, 0.01), 1221 (3, 0). (except the yellow ones, for the other waveform the overtone1 model is preferred over TCTM0 in low SNR cases.)
    • A summary of current results.
    • New version paper in progress.
  2. Next step?

    • Test 0150 with high SNR.
    • Even better summary of the results: a table with the event names, their mass ratio, spin (or both initial z-component spins), and the Bayes factor between both models (at low SNR, and the one at high SNR too if you have it)
    • Modification will start from the section 6.
    • Add the Fig. 3 in appendix and in main texts we mention it as a motivation for us to use the HTPM and TCTM.
    • remove the expression of other models into appendix.
    • subsections for different waveforms, showing mass/spin contours.
    • 1 particular plot showing the posteriors for A and tau (Appendix).
  3. Other suggestions:

    • Write to Mike Boyle and ask about how to install them correctly (c.c. Xisco and Pierre). (don't tell specific)

    • Test with model having 8 parameters with more cores.

    • Try to figure out why the actual core numbers used in atlas is so small.

5-17

List:

  1. Delete the former comments.
  2. Delete irrelevant parts.
  3. Find 3 main points (sub/section level para) to add for parts before section VI.
    • sampling process
    • Bayes analysis
    • modified models and appendix.
  4. Add the paras.
  5. Make plots.
  6. Add the descriptions for plots.
  7. Add the paras.

5-18

Discussion:

  • Scri package installation

  • Bayes factor table:

    Mass Ratio Spin SNR=20 SNR=100 SNR=1000
    BBH:0150 1 0.2 0.687 10.12 993.35
    BBH:0305 1.221 0.01 0.247 -15 -293.49
    BBH:1221 3 0 -0.452 -26.24 -2718.24
    BBH:0300 8.5 0 -0.339 -40.69 -4196.08

Suggestions:

  • Try with the full version of conda.
  • Try to use 0.01 for low SNR cases.

5-24

To do list:

  1. draw the pictures (30mins).
  2. set them into paper with captions (30mins).
  3. fix appendix (15mins)
  4. modify the content of section4 and appendix (1h)
  5. Main contents of results (1h)
  6. Try fix the anaconda (45mins)

5-25

Progress:

  • Several parts of the paper results and models.
  • Todo list: the theoretical parts of Bayes factor/sampling and intro/abstract/appendix/conclusion.
  • How about the new data? (ask Pierre)

Discussion:

  • Structure of the paper?
    • Try to concentrate on the 0305 and the other subsections can be reduced into 1.

Other Suggestions:

  • Reduce the range of mass-spin contours.
  • Leave only the contours (and remove the marginalized dis)
  • combine the four waveform results together into 1 plot.
  • Maybe we can remove the SNR=1000 case in the contour plots.
  • Try to sample the OM0 cases as well.

6-1

  1. Updates:
    • Ext-CCE data successfully transformed.
    • Ext-CCE:0006 sampling results.
    • Paper: completed Bayes factor/sampling setup/new likelihood function parts.
  2. Discussion:
    • Main conclusions based on current results?
      • I just need to conclude from the normal waveform.
    • Where is the bset to insert the Ext-CCE results?
      • Keep it outside the table/paper.
    • Minor adjustment on the GetAsymptoticMultiMode function of the RDown.m package to work for.
  3. Other suggestions?
    • ⟨d−m(θ⃗),d−m(θ⃗)⟩ for frequency domain inner product.
    • Calculate the actual difference between.

6-17

  1. Updates:
    • Ext-CCE results.
    • New plots with OM0 posteriors included.
    • Abstract, Results and Discussion sections first version completed.
  2. Questions & Discussion
    • Theoretical motivation of TCTM?
      • Allowing modification functionally.
    • Fixing positioning of appendix plots.
      • Let latex decides.
    • Possible explanations for why only the spinning equal mass binary waveform have TCTM better than OM?
      • Extreme mass ratio makes the perturbation theory assumption more ideal, thus OM are going to perform better.
    • Improvements on the plots?
      • Adjust the padding between labels and ticks.
    • First impression on the abstract?
      • Tell Xisco and Pierre in the chat when anything is thought as finished for me.
    • Any recommended latest papers for?
      • https://arxiv.org/abs/2205.07809
      • https://arxiv.org/abs/2201.00822
      • (Focus on the intro/abs)
  3. Todo:
    • Read more latest papers to finalize the intro.
    • Review & edit the whole paper firstly with myself.
  4. Suggestions:
    • for Bayes factor.
    • To find the previous plot which has Bayes factors of also HTPM (Lineplot, maybe).
    • Try to reproduce all the sampling for t=10.

6-20

  1. Plan:
    • Intro
    • Theory
    • Plots
    • Appendix

6-23

  1. Update:

    • t0=10 results.

    • Waveform: (log_evidence) OM1(snr20), TCTM0(snr20) //OM1(snr100), TCTM0(snr100)

      BBH:0150: -13.995, -13.435 // -30.207, -28.121

      BBH:1221: -13.021, -12.109 // -22.385, -28.214

      BBH:0300: -12.987, -12.058 // -22.314, -27.907

    • Introduction completed.

  2. Suggestions:

    • Try to collect the latest codes and update them in the GitHub repo.
    • Other sampling results with different starting time (ideally). (maybe -5, 5, 15, 20).
    • Make a table (check the posteriors and the trend) for t0=10.
    • ==Switch the mod-com plot and part of the description in append with Fig. 1.==

7-6

  1. Updates:

    • First version of full paper (all parts go through myself).
    • Different truncation time results (need to rerun the t0=15 case).
    • Improved plots in paper.
    • New code for easy auto-sampling/bayes factor calculation/save data and check plots.
  2. Questions/Suggestions:

    • Maybe we can start the first-review now?

    • Explain why there is difference between SNR=20 and SNR=100.

    • Explain way mass is ~0.5-1.5.

    • "accounting_group = cbc.imp.pe" may work.

7-20

  1. Corrections update.
  2. Discuss about the constant noise assumption arguments.
    • Try compute the GW150914 like 220, 221 frequncy sensitivity S(f) value.
  3. Show the different time results
    • Which plots to use in paper?
      • Add the label(range) of the strong evidence (not decisive)
      • The mass spin plot can also be in the paper.
  4. (Extra: ask about probability).
    • The realistic probability can't be given precisely.

7-28

  1. Update:
    • Different time results section completed.
    • OM2 running.
  2. Question:
    • How to deal with comments now?
  3. Suggestions:
    • Rerun the different time results with scaled SNR.

8-24

  1. Updates:
    • Correct the SNR decreasing sampling.
  2. Next step:
    • Editing the latter part of the paper (focus on the results part).
    • Add some more discussions on the SNR variation in the larger t0 cases.
  3. Suggestions:
    • Add more descriptions to the plots.
    • Meet next Friday.

9-7

  1. Update:

    • Correct the SNR decreasing sampling.
    • Edited accordingly for latter half of the results section. Add some more discussions on the SNR variation in the larger t0 cases.
  2. My schedule in the near future:

    • Qualify exam in Oct. 1st
  3. Discussion:

    • Plan:

      • TCTM1 and OM2 sampling for t0=0, SNR=20, 100.

9-21

  1. Update:
    • dlogz stucked at ~3 for SNR=20
    • dlogz stucked at ~90 for a while for SNR=100, could go down to ~30 if running ~50h with 32 cpus.
  2. Solutions:
    • Check the codes again to see if there could be improvements.
      • Calculate the np.abs(h1_selected)**2
      • Try remove the interpolation of m/a -- w/tau outside of the function.
    • Use different methods in nested-sampling.
    • apply dlogz=5, and dlogz=50 for all the tests (rerun the former ones).

10-13

  1. Check the code
    • /RDFits.ipynb
  2. Finding scripts.
    • jupyter file
  3. Suggestions

5-25

  1. Time constraints for each one?

    • Me: no actual time constraint, should be more efficient than ever (hopefully :)
  2. Updates:

    • Nothing "new"... but I have been reading all the codes, paper, ipynb... once again these days.
    • The script for MCMC sampling and Bayes factor computing with various setup (t0, SNR, model) is still valid and ready-to-go.
    • Paper may need to be rewritten for most parts...which shouldn't take too much time though (guess my english improved...)
  3. Plan & To be discussed

    • TCTM1 and OM2 sampling for t0=0, SNR=20, 100.
    • Our current result: with q=1, TCTM works better, i.e. supporting the nonlinear effects (only for Bayes factor, not mass/spin bias). Is this solid for the main part of paper or we need to add something else?
    • Any other interesting points we could show in the paper?

7-13

  1. Update
    • OM2, OM3 full sampling.
    • Prior of PhenomD.
  2. Discussion
    • PhenomD prior/other setup.
    • Use BIC?
  3. Todolist
    • try priors of OM to be [0.8,1], [0.9,1]... check bayes factors
    • (fix TCTM2 full sampling.
    • add OM4.

8-23

  1. export LAL_DATA_PATH = nrsur_path:$LAL_DATA_PATH
  2. /work/shilpa.kastha/open_catalog/lal_data_for_NRSur/NRSur7dq4.h5

8-31

Venv solution:

  1. In VSCode open your command palette — Ctrl+Shift+P by default
  2. Look for Python: Select Interpreter
  3. In Select Interpreter choose Enter interpreter path... and then Find...
  4. Navigate to your venv folder — eg, ~/pyenvs/myenv/ or \Users\Foo\Bar\PyEnvs\MyEnv\
  5. In the virtual environment folder choose <your-venv-name>/bin/python or <your-venv-name>/bin/python3

9-22

  1. Todo:
    • Mismatch: try fixing the phase or grid on other parameters.
    • Calculate the epsilon for PhenomD.
    • Test with OM with 4 parameters.
    • Different waveform for Ext:CCE.

9-25

  1. Updates:
    • Bayes factor
  2. To discuss:
    • Reasoning on instability
    • EXTCCE.
  3. In-progress:
    • Epsilon/mismatch plot update.
    • different time.
    • different time for 4 parameters of OM3.

9-26

  1. Updates with Pierre
  2. Timeline/Todo list
    • Draft leftover
      • Intro (Xisco)
      • Abstract
      • Conclusion (Xisco)
      • Results on different waveform as a table (Yi)
    • Timeline
      • Section3 first review (Pierre)
      • 1st week, results + intro/conclusion
      • 2nd week, later results + review
      • 3rd week, last review.
    • Works in parallel
      • Different time for 4par OM3
      • Different time for OM0-2
      • Change the fix4par to sample the highest tone's amp/phase.
      • Test with other waveform with different truncating times.

10-3

  1. Which sections in results?

    • Subsection A: Bayes factor (potentially also TCTM, HTPM)

    • Subsection B: bias plot

    • Subsection C: different time

    • Subsection D: different waveform

  2. Which sections in appendix?

    • 4par version rubustness test (with both different time and bias plots) on OM?
    • Ext-CCE different time plot (or discussion in subsection D)?
    • prior tests.
  3. Others

    • Try to do HTPM1 sampling.

10-6

  1. Updates:
    • Different time for ExtCCE still running
    • Result/appendix part should be done by next
  2. To be discussed:
    • Confirm about the plan of plots.
      • 2 plots for bias. (1 add TCTM, 2 remove one of the overtone model, change color and range.)
      • Sub A/D come with tables.
      • Different t0 stays the same (optionally add TCTM0)
    • message to convey in each result section.
    • Introduction to the 4par model? (in results section)
    • which models to put into the plot.
    • Timeline for finalizing the project.

10-11

  1. Discussion

    • Shorthanded terms.

      RD, NR, IMRPhenomD (change the plot), OM, change the bold model name to normal in text.

      For all the OM, use \(\text{OM}_n\), u

    • table caption

  2. How to proceed.

    • Add HTPM1
  3. Updates:

    • Fig. 3: HTPM1, TCTM1, OM2, PhenomD (optionally TCTM0).
    • Remove 4-par models (maybe appendix).
    • appendix priors description (refer to ligo catalog paper.)
  4. Remaining test

    -Ext-CCE other result in appendix

10-25

  1. HTPM/TCTM

    • what message should we give
    • prior looks fine on HTPM?
  2. Plan

    • appendix2 with corner plots for ExtCCE:002.
    • Extend the Table 2 to include all bayes evidence the same as Table 1?
    • Others?
  3. Timeline for writing:

  4. Notes for shortcut:

    • RD, BH

Nov 7

  1. Scri decompress code.
  2. Discussion on Ext-CCE's results.
  3. Epsilon distribution.
  4. go through 2a.
  5. OM amplitude prior fix in the table.

Nov 24

  1. Plan?
    • Fix the OV to OM
    • Add another table for epsilon in result.5

Dec 7

  1. Change slides.
  2. practice 3 more times.

Dec 19

  1. Adding citation for 2
  2. change the fig. 5 and relevant text in result and conclusion sections.
  3. Reply to the email of vasco.
  4. create arxiv account.

Jan 10

  1. Ref to add
    1. Page 2 intro about starting time.
  2. mass/spin relation to w/tau.
  3. Submission to arxiv
  4. Submission to PRD

Feb 9

  1. Test 3,2,0 and compare to HTPM1's first/fundamental tone frequencies.

Feb 16

  1. OM3, 4 results update, also update V-A-3
  2. II-A-2 add text to the main paper. may refer to the paper.
  3. sort out GC2 and III-D-1, V-A-1, V-E-1.

Feb 20

  1. Update the OM4 fig and table, comment on caption of Table I about the uncertainties of epsilons as well.
  2. Highlight all text relevant to IMR calibration in main text.
  3. Sort out the GC2 and III-D-1, V-A-1, V-E-1 in reply.
  4. Add texts about IMR not calibrated only for RD to II-C in paper and also V-A or V-E.
  5. Test with high SNR and more nlive points.

Feb 21

  1. Try new runs for OM4, and compare the posteriors and see what changes we need to make about OM4.
  2. Add texts about SNR choice and possible limitation on the saturation of OM performance in the corresponding text to the reply to VI-1, V-A-3 and page 7, 8.