Validation of PhEq_bootstrap [Software]
Hi Hötzi,
Yes, that is a lot. Perhaps a lot of time is spent writing the datasets to file streams and flushing file buffers.
Still, let us say 6 time points, 12 chambers, 2 formulation: ~144 Mb, plus the array of f2*. Allocating that sort of memory should not be an issue ever on newer hardware. The browser you have opened right now to read this post consumes a lot more, probably by a factor 4-10
What is the use of having all that info cached??
Under bootstrapping the i'th dataset is as valid as the j'th dataset where (i,j) is in ([0;B], [0;B]). When I write resampling code I usually just extract a few dataset and print e.g. the 111'th sample or whatever and check that it has the right set of elements (i.e. that the 111'th dataset (or whatver) for Test only has Test values at the 'right' time points and so forth). And I can check that the derived f2* is one I can reproduce by manual calculation in another application. It isn't such a lot of work. But if I had to do that for a million datasets, then I'd be very, very late for dinner.
What I find little more tricky is to convince myself that the derivation of CI's from the vector of f2* values is valid. A key element here is the sorting. What I did once was to output the sorted first 65536 rows of the sorted array and import them in a spreadsheet (if I recall correctly 65536 is the maximum number of rows in my spreadsheet). Then copy those values to another column, sort this column, and check if row difference exist. A row difference would indicate a sorting mishap in one of the applications. Never observed it, fortunately.
❝ Dokumentation, darling! The file contains not only the four estimates (ƒ1, ƒ2, unbiased ƒ2, ƒ2*) in full precision for the X bootstraps but also the raw data (+average, variance) of all samples. That’s a fucking lot.
Yes, that is a lot. Perhaps a lot of time is spent writing the datasets to file streams and flushing file buffers.
Still, let us say 6 time points, 12 chambers, 2 formulation: ~144 Mb, plus the array of f2*. Allocating that sort of memory should not be an issue ever on newer hardware. The browser you have opened right now to read this post consumes a lot more, probably by a factor 4-10
What is the use of having all that info cached??
Under bootstrapping the i'th dataset is as valid as the j'th dataset where (i,j) is in ([0;B], [0;B]). When I write resampling code I usually just extract a few dataset and print e.g. the 111'th sample or whatever and check that it has the right set of elements (i.e. that the 111'th dataset (or whatver) for Test only has Test values at the 'right' time points and so forth). And I can check that the derived f2* is one I can reproduce by manual calculation in another application. It isn't such a lot of work. But if I had to do that for a million datasets, then I'd be very, very late for dinner.
What I find little more tricky is to convince myself that the derivation of CI's from the vector of f2* values is valid. A key element here is the sorting. What I did once was to output the sorted first 65536 rows of the sorted array and import them in a spreadsheet (if I recall correctly 65536 is the maximum number of rows in my spreadsheet). Then copy those values to another column, sort this column, and check if row difference exist. A row difference would indicate a sorting mishap in one of the applications. Never observed it, fortunately.
—
Pass or fail!
ElMaestro
Pass or fail!
ElMaestro
Complete thread:
- Validation of PhEq_bootstrap Helmut 2018-07-12 17:47 [Software]
- Validation of PhEq_bootstrap ElMaestro 2018-07-12 22:21
- Validation of PhEq_bootstrap Helmut 2018-07-13 01:29
- Validation of PhEq_bootstrapElMaestro 2018-07-13 10:14
- Validation of PhEq_bootstrap Helmut 2018-07-13 12:54
- Validation of PhEq_bootstrap ElMaestro 2018-07-13 14:28
- Validation of PhEq_bootstrap Helmut 2018-07-13 12:54
- Validation of PhEq_bootstrapElMaestro 2018-07-13 10:14
- Validation of PhEq_bootstrap Helmut 2018-07-13 01:29
- Validation of PhEq_bootstrap Shuanghe 2018-07-17 15:54
- PhEq_bootstrap in R d_labes 2018-08-15 09:45
- bootf2BCA v1.1 Helmut 2019-10-05 00:59
- bootf2BCA v1.2: seed Helmut 2020-09-25 19:37
- bootf2BCA v1.2: seed PTM139 2021-04-16 07:53
- Which packages, working directory? Helmut 2021-04-16 10:50
- Which packages, working directory? PTM139 2021-04-27 13:02
- Which packages, working directory? Helmut 2021-04-16 10:50
- bootf2BCA v1.2: seed Rayhope 2022-03-28 14:35
- bootf2BCA v1.3 Helmut 2022-03-28 14:48
- bootf2BCA v1.3 Rayhope 2022-03-30 06:34
- bootf2BCA v1.3 Helmut 2022-03-28 14:48
- bootf2BCA v1.2: seed PTM139 2021-04-16 07:53
- bootf2BCA v1.1 Flam 2023-06-21 03:41
- bootf2BCA v1.3.1 (current since 2022-06-25) Helmut 2023-06-23 13:47
- bootf2BCA v1.3.1 (current since 2022-06-25) Flam 2023-06-26 23:16
- Install required packages first Helmut 2023-06-27 11:47
- bootf2BCA v1.3.1 (current since 2022-06-25) Flam 2023-06-26 23:16
- bootf2BCA v1.3.1 (current since 2022-06-25) Helmut 2023-06-23 13:47
- bootf2BCA v1.2: seed Helmut 2020-09-25 19:37
- bootf2BCA v1.1 Helmut 2019-10-05 00:59
- Validation of PhEq_bootstrap Rayhope 2021-07-29 08:49
- Validation of PhEq_bootstrap Helmut 2021-08-02 18:12
- Validation of PhEq_bootstrap ElMaestro 2018-07-12 22:21