SEP report reproducibility test guideline

Requirement for repro test

If you have more complex reproducing strategies rather than typing make. You need to include a readme file or put the instructions at the top of make file as comment.

The quality of reproducibility will be evaluated in five aspects:

1. All Code compiles on SEP computing environment

2. flow for CR figures is present in makefile

3. ER figures can be reproduced

4. Makefile is written in a clear/concise/neat manner

5. CR figures can be reproduced.

The last two are optional, but rest are mandatory(everyone needs to pass in order to pass the test). Also we will check that proper reproducibility label are assigned to each figures.

makefile format

It is not rare that your makefile will have dozens of entries. We are not able to check all of these. Therefore, we require the makefile to have several common targets, i.e

1. make burn; burn all the figures in the paper.

2. make clean; burn all figures, and also clean the executables and the intermediate result file (.H).

3. make NR; build NR figures; (this could be a simple copy from a backup folder).

4. make ER; build ER figures

5. make CR; build CR figures

Again, you can back up your figures to a separate folder, but it is not OK to just copy them back to directory Fig in those figures making rules.

FAQs

1. What is the rule of thumb of choosing NR/ER/CR labels for a plot?

You should have known it while you were writing the report. Please refer to the up-to-date instructions @ vostok:/wrk/sep147/Adm/preface.tex for details.

2. Do I need to include all the .H files I used in the figures in the local directory?

You are not forbidden from doing that just for backup purpose. However, your makefile flows for building these figures should start from the raw input data file, perform the computations and then generate the figures. The only exception is plotting the raw data, since no computation needs to be performed. Simply grabbing backed-up intermediate results (.H files) and plotting them is not considered a valid reproducible flow, unless it is NR.

3. My makefile rules take a long time to compute, how can I test them more efficiently?

'-n' option in Make would show the user nominally all the cmds GNUmake would execute for this target, but without actually executing them. e.g make -n target.H rather than make target1.H. This would help you diagnose many of the mistakes you might have in your make file in advance. For example, a filename typo in the dependence list.

Tips

1. put a dash '-' at the beginning of the command, if you want Make to continue the flow in case of an error. For eg.

buildx:
  - mkdir bin
  make bin/exe.x

Testing score sheet SEP 147

code CR Fig Flows ER figs can Makefile CR figs can
Papers: Filename compiles present be rebuilt Clarity be rebuilt note
Paper1 jasonpc1 Y Y - Y Y
Paper2 nfarghal1 Y - Y Y -
Paper3 musa1 Y Y Y Y Y
Paper6 yishen1 Y - Y Y Y
Paper7 qiang Y - Y Y -
Paper8 chris1 Y Y Y Y Y
Paper9 chris2 Y Y - Y Y
Paper10 ali1 Y Y Y Y Y
Paper11 yang1 Y Y Y Y Y
Paper12 yang2 Y Y Y - Y
Paper13 ohad1 Y Y Y Y Y
Paper14 mandy1 Y Y - Y -
Paper15 mandy2 Y Y - Y Y
Paper16 elita1 - - - - -
Paper17 elita2 Y Y - Y Y
Paper18 elita3 Y Y Y Y Y
Paper19 sjoerd1 Y Y Y Y Y
Paper20 sjoerd2 Y Y Y Y Y
Paper21 adam1 Y Y Y Y Y
Paper22 adam2 Y Y Y Y Y
Paper23 xukai1 Y Y Y Y Y
Paper24 xukai2 Y Y Y Y -
Paper25 xukai3 Y Y Y Y -
Paper26 xukai4 - - - - -
Paper27 biondo1 Y Y Y Y Y
Paper28 bob1 Y - Y Y -
Paper29 stew1 Y Y Y Y -
Paper30 jon1 Y - Y Y -
Paper31 jon2 Y - Y Y -

Y: Yes/Passed

N: No/Failed

-: Not applicable. (for example, if one paper has no CR figures)

Paper Titles

Paper1: Jason P. Chang and Sjoerd de Ridder, “Correlation energy between surface and borehole stations at the Valhall Field”

Paper2: Noha S. Farghal and Stewart A. Levin, “Hunting for microseismic reflections using multiplets”

Paper3: Musa Maharramov, “Identifying reservoir depletion patterns from production-induced deformations with applications to seismic imaging”

Paper6: Yi Shen, “Estimation of Q from surface-seismic reflection data in data space and image space”

Paper7: Qiang Fu and Jon Claerbout, “Recently progress regarding logarithm Fourier domain bidirectional deconvolution”

Paper8: Chris Leader and Robert Clapp, “Linearised inversion with GPUs”

Paper9: Chris Leader and Ali Almomin, “How incoherent can we be? Phase encoded linearised inversion with random boundaries”

Paper10: Ali Almomin and Biondo Biondi, “Tomographic full waveform inversion: Practical and computationally feasible approach”

Paper11: Yang Zhang and Biondo Biondi, “Residual moveout based wave equation migration velocity analysis in 3-D”

Paper12: Yang Zhang and Adam D. Halpert, “Enhanced interpreter-aided salt-boundary extraction using shape deformation”

Paper13: Ohad Barak, “P/S separation of OBS data by inversion in a homogeneous media”

Paper14: Mandy Wong, Shuki Ronen, and Biondo Biondi, “Joint imaging with Streamer and ocean bottom data”

Paper15: Mandy Wong, Biondo Biondi, and Shuki Ronen, “Imaging with multiples using linearized full-wave inversion”

Paper16: Yunyue (Elita) Li, Peng Shen, and Colin Perkins, “VTI Migration velocity analysis using RTM”

Paper17: Yunyue (Elita) Li, “Wave-equation migration velocity analysis for anisotropic models on 2-D ExxonMobil field data”

Paper18: Yunyue (Elita) Li, “Wave-equation migration velocity analysis for VTI media using optimized implicit finite difference”

Paper19: Sjoerd de Ridder, “Continuous reservoir monitoring by ambient seismic noise tomography”

Paper20: Sjoerd de Ridder, “Surface wave tomography based on FWI of the 2 dimensional scalar wave equation”

Paper21: Adam Halpert, “Edge-preserving smoothing for segmentation of seismic images”

Paper22: Adam Halpert, “Fast velocity model evaluation with synthesized wavefields”

Paper23: Xukai Shen, “Early-arrival waveform inversion for near-surface velocity and anisotropic parameters: Modeling and sensitivity kernel analysis”

Paper24: Xukai Shen, “Early-arrival waveform inversion for near-surface velocity and anisotropic parameters: Inversion of synthetic data”

Paper25: Xukai Shen and Robert G. Clapp, “Short Note: FWI with different boundary conditions”

Paper26: Xukai Shen and Tieyuan Zhu, “Short Note: Early arrival waveform inversion: Application to crosswell field data”

Paper27: Biondo Biondi and Ali Almomin, “Tomographic full waveform inversion (TFWI) by combining full waveform inversion with wave-equation migration velocity anaylisis”

Paper28: Robert G. Clapp, “Image gather reconstruction using STOMP”

Paper29: Stewart A. Levin, “Integral operator quality from low order interpolation”

Paper30: Jon Claerbout, “Polarity preserving decon in N logN time”

Paper31: Jon Claerbout, Antoine Guitton, and Qiang Fu, “Decon in the log domain with variable gain”

sep/internal/reprotest147.txt · Last modified: 2015/05/27 02:06 (external edit)
CC Attribution-Share Alike 4.0 International
Driven by DokuWiki Recent changes RSS feed Valid CSS Valid XHTML 1.0