Validation of PhEq_bootstrap [Software]
Hi Hötzi,
The magnitude of the variability of the estimate is dependent on the number of bootstraps and the within- and between-variability. This is just the nature of it.
What I don't quite get is how the need for 80 Mb files (files, really???) arises. For 25000 bootstraps you should only need to allocate e.g. 25000x a double datatype (8 bytes) for the storage of f2*, which isn't even a megabyte from the heap. But note I did not care to read any of the Pascal source code. However, speed or memory consumption is a mundane issue. If the calculation is proper then no need to whine at all.
When I do this in C, I allocate 8 Mbs from the heap, and it takes a blink of an eye or two with a million bootstraps and sorting, and no intermediary files anywhere, and it provides derivation of the bootstrap CI in various flavours: Raw, bias corrected, and bias corrected and accelerated.
❝ Bootstrapping converges to the true value with increasing repetitions. If you want to get reproducible results you have to use a workaround and go for 25,000+ bootstraps. Then the results are stable but you have to accept ~80MB result-files…
❝ Of course this is only valid for these data sets (12 units, 4 sampling time points). Good luck with more time points.
The magnitude of the variability of the estimate is dependent on the number of bootstraps and the within- and between-variability. This is just the nature of it.
What I don't quite get is how the need for 80 Mb files (files, really???) arises. For 25000 bootstraps you should only need to allocate e.g. 25000x a double datatype (8 bytes) for the storage of f2*, which isn't even a megabyte from the heap. But note I did not care to read any of the Pascal source code. However, speed or memory consumption is a mundane issue. If the calculation is proper then no need to whine at all.
When I do this in C, I allocate 8 Mbs from the heap, and it takes a blink of an eye or two with a million bootstraps and sorting, and no intermediary files anywhere, and it provides derivation of the bootstrap CI in various flavours: Raw, bias corrected, and bias corrected and accelerated.
—
Pass or fail!
ElMaestro
Pass or fail!
ElMaestro
Complete thread:
- Validation of PhEq_bootstrap Helmut 2018-07-12 17:47 [Software]
- Validation of PhEq_bootstrapElMaestro 2018-07-12 22:21
- Validation of PhEq_bootstrap Helmut 2018-07-13 01:29
- Validation of PhEq_bootstrap ElMaestro 2018-07-13 10:14
- Validation of PhEq_bootstrap Helmut 2018-07-13 12:54
- Validation of PhEq_bootstrap ElMaestro 2018-07-13 14:28
- Validation of PhEq_bootstrap Helmut 2018-07-13 12:54
- Validation of PhEq_bootstrap ElMaestro 2018-07-13 10:14
- Validation of PhEq_bootstrap Helmut 2018-07-13 01:29
- Validation of PhEq_bootstrap Shuanghe 2018-07-17 15:54
- PhEq_bootstrap in R d_labes 2018-08-15 09:45
- bootf2BCA v1.1 Helmut 2019-10-05 00:59
- bootf2BCA v1.2: seed Helmut 2020-09-25 19:37
- bootf2BCA v1.2: seed PTM139 2021-04-16 07:53
- Which packages, working directory? Helmut 2021-04-16 10:50
- Which packages, working directory? PTM139 2021-04-27 13:02
- Which packages, working directory? Helmut 2021-04-16 10:50
- bootf2BCA v1.2: seed Rayhope 2022-03-28 14:35
- bootf2BCA v1.3 Helmut 2022-03-28 14:48
- bootf2BCA v1.3 Rayhope 2022-03-30 06:34
- bootf2BCA v1.3 Helmut 2022-03-28 14:48
- bootf2BCA v1.2: seed PTM139 2021-04-16 07:53
- bootf2BCA v1.1 Flam 2023-06-21 03:41
- bootf2BCA v1.3.1 (current since 2022-06-25) Helmut 2023-06-23 13:47
- bootf2BCA v1.3.1 (current since 2022-06-25) Flam 2023-06-26 23:16
- Install required packages first Helmut 2023-06-27 11:47
- bootf2BCA v1.3.1 (current since 2022-06-25) Flam 2023-06-26 23:16
- bootf2BCA v1.3.1 (current since 2022-06-25) Helmut 2023-06-23 13:47
- bootf2BCA v1.2: seed Helmut 2020-09-25 19:37
- bootf2BCA v1.1 Helmut 2019-10-05 00:59
- Validation of PhEq_bootstrap Rayhope 2021-07-29 08:49
- Validation of PhEq_bootstrap Helmut 2021-08-02 18:12
- Validation of PhEq_bootstrapElMaestro 2018-07-12 22:21