ARROW-28: Adding google's benchmark library to the toolchain by emkornfield · Pull Request #29 · apache/arrow

@emkornfield

@emkornfield

@emkornfield changed the title WIP-Arrow-28 Adding google's benchmark library to the toolchain Arrow-28 Adding google's benchmark library to the toolchain

Mar 20, 2016

@emkornfield emkornfield changed the title Arrow-28 Adding google's benchmark library to the toolchain Arrow-28: Adding google's benchmark library to the toolchain

Mar 21, 2016

@emkornfield emkornfield changed the title Arrow-28: Adding google's benchmark library to the toolchain ARROW-28: Adding google's benchmark library to the toolchain

Mar 22, 2016

@emkornfield

wesm pushed a commit to wesm/arrow that referenced this pull request

Sep 8, 2018
Author: Aliaksei Sandryhaila <aliaksei.sandryhaila@hp.com>

Closes apache#29 from asandryh/parquet-472 and squashes the following commits:

4bcbbb1 [Aliaksei Sandryhaila] Addressed review comments.
58c2da2 [Aliaksei Sandryhaila] PARQUET-472: Changed the ownership of InputStream in ColumnReader.

Change-Id: I1a4c2623c229516ddd88ccc0cc688afe3609a1b3

wesm pushed a commit to wesm/arrow that referenced this pull request

Sep 8, 2018
Based on @emkornfield 's work in apache#29

Author: Uwe L. Korn <uwelk@xhochy.com>

Closes apache#93 from xhochy/parquet-512 and squashes the following commits:

ebc10d2 [Uwe L. Korn] Fix signed/unsigned comparison
684dbc6 [Uwe L. Korn] Fix c&p bug
5a8e239 [Uwe L. Korn] Build benchmarks but don't run them in Travis
e7dc34c [Uwe L. Korn] Remove Arrow references
f6b02da [Uwe L. Korn] PARQUET-512: Add Google benchmark for performance testing

Change-Id: Icb0d5d7d3886503c74b89a5fc517932a84cfc1b9

kou pushed a commit that referenced this pull request

May 10, 2020
This PR enables tests for `ARROW_COMPUTE`, `ARROW_DATASET`, `ARROW_FILESYSTEM`, `ARROW_HDFS`, `ARROW_ORC`, and `ARROW_IPC` (default on). #7131 enabled a minimal set of tests as a starting point.

I confirmed that these tests pass locally with the current master. In the current TravisCI environment, we cannot see this result due to a lot of error messages in `arrow-utility-test`.

```
$ git log | head -1
commit ed5f534
% ctest
...
      Start  1: arrow-array-test
 1/51 Test  #1: arrow-array-test .....................   Passed    4.62 sec
      Start  2: arrow-buffer-test
 2/51 Test  #2: arrow-buffer-test ....................   Passed    0.14 sec
      Start  3: arrow-extension-type-test
 3/51 Test  #3: arrow-extension-type-test ............   Passed    0.12 sec
      Start  4: arrow-misc-test
 4/51 Test  #4: arrow-misc-test ......................   Passed    0.14 sec
      Start  5: arrow-public-api-test
 5/51 Test  #5: arrow-public-api-test ................   Passed    0.12 sec
      Start  6: arrow-scalar-test
 6/51 Test  #6: arrow-scalar-test ....................   Passed    0.13 sec
      Start  7: arrow-type-test
 7/51 Test  #7: arrow-type-test ......................   Passed    0.14 sec
      Start  8: arrow-table-test
 8/51 Test  #8: arrow-table-test .....................   Passed    0.13 sec
      Start  9: arrow-tensor-test
 9/51 Test  #9: arrow-tensor-test ....................   Passed    0.13 sec
      Start 10: arrow-sparse-tensor-test
10/51 Test #10: arrow-sparse-tensor-test .............   Passed    0.16 sec
      Start 11: arrow-stl-test
11/51 Test #11: arrow-stl-test .......................   Passed    0.12 sec
      Start 12: arrow-concatenate-test
12/51 Test #12: arrow-concatenate-test ...............   Passed    0.53 sec
      Start 13: arrow-diff-test
13/51 Test #13: arrow-diff-test ......................   Passed    1.45 sec
      Start 14: arrow-c-bridge-test
14/51 Test #14: arrow-c-bridge-test ..................   Passed    0.18 sec
      Start 15: arrow-io-buffered-test
15/51 Test #15: arrow-io-buffered-test ...............   Passed    0.20 sec
      Start 16: arrow-io-compressed-test
16/51 Test #16: arrow-io-compressed-test .............   Passed    3.48 sec
      Start 17: arrow-io-file-test
17/51 Test #17: arrow-io-file-test ...................   Passed    0.74 sec
      Start 18: arrow-io-hdfs-test
18/51 Test #18: arrow-io-hdfs-test ...................   Passed    0.12 sec
      Start 19: arrow-io-memory-test
19/51 Test #19: arrow-io-memory-test .................   Passed    2.77 sec
      Start 20: arrow-utility-test
20/51 Test #20: arrow-utility-test ...................***Failed    5.65 sec
      Start 21: arrow-threading-utility-test
21/51 Test #21: arrow-threading-utility-test .........   Passed    1.34 sec
      Start 22: arrow-compute-compute-test
22/51 Test #22: arrow-compute-compute-test ...........   Passed    0.13 sec
      Start 23: arrow-compute-boolean-test
23/51 Test #23: arrow-compute-boolean-test ...........   Passed    0.15 sec
      Start 24: arrow-compute-cast-test
24/51 Test #24: arrow-compute-cast-test ..............   Passed    0.22 sec
      Start 25: arrow-compute-hash-test
25/51 Test #25: arrow-compute-hash-test ..............   Passed    2.61 sec
      Start 26: arrow-compute-isin-test
26/51 Test #26: arrow-compute-isin-test ..............   Passed    0.81 sec
      Start 27: arrow-compute-match-test
27/51 Test #27: arrow-compute-match-test .............   Passed    0.40 sec
      Start 28: arrow-compute-sort-to-indices-test
28/51 Test #28: arrow-compute-sort-to-indices-test ...   Passed    3.33 sec
      Start 29: arrow-compute-nth-to-indices-test
29/51 Test #29: arrow-compute-nth-to-indices-test ....   Passed    1.51 sec
      Start 30: arrow-compute-util-internal-test
30/51 Test #30: arrow-compute-util-internal-test .....   Passed    0.13 sec
      Start 31: arrow-compute-add-test
31/51 Test #31: arrow-compute-add-test ...............   Passed    0.12 sec
      Start 32: arrow-compute-aggregate-test
32/51 Test #32: arrow-compute-aggregate-test .........   Passed   14.70 sec
      Start 33: arrow-compute-compare-test
33/51 Test #33: arrow-compute-compare-test ...........   Passed    7.96 sec
      Start 34: arrow-compute-take-test
34/51 Test #34: arrow-compute-take-test ..............   Passed    4.80 sec
      Start 35: arrow-compute-filter-test
35/51 Test #35: arrow-compute-filter-test ............   Passed    8.23 sec
      Start 36: arrow-dataset-dataset-test
36/51 Test #36: arrow-dataset-dataset-test ...........   Passed    0.25 sec
      Start 37: arrow-dataset-discovery-test
37/51 Test #37: arrow-dataset-discovery-test .........   Passed    0.13 sec
      Start 38: arrow-dataset-file-ipc-test
38/51 Test #38: arrow-dataset-file-ipc-test ..........   Passed    0.21 sec
      Start 39: arrow-dataset-file-test
39/51 Test #39: arrow-dataset-file-test ..............   Passed    0.12 sec
      Start 40: arrow-dataset-filter-test
40/51 Test #40: arrow-dataset-filter-test ............   Passed    0.16 sec
      Start 41: arrow-dataset-partition-test
41/51 Test #41: arrow-dataset-partition-test .........   Passed    0.13 sec
      Start 42: arrow-dataset-scanner-test
42/51 Test #42: arrow-dataset-scanner-test ...........   Passed    0.20 sec
      Start 43: arrow-filesystem-test
43/51 Test #43: arrow-filesystem-test ................   Passed    1.62 sec
      Start 44: arrow-hdfs-test
44/51 Test #44: arrow-hdfs-test ......................   Passed    0.13 sec
      Start 45: arrow-feather-test
45/51 Test #45: arrow-feather-test ...................   Passed    0.91 sec
      Start 46: arrow-ipc-read-write-test
46/51 Test #46: arrow-ipc-read-write-test ............   Passed    5.77 sec
      Start 47: arrow-ipc-json-simple-test
47/51 Test #47: arrow-ipc-json-simple-test ...........   Passed    0.16 sec
      Start 48: arrow-ipc-json-test
48/51 Test #48: arrow-ipc-json-test ..................   Passed    0.27 sec
      Start 49: arrow-json-integration-test
49/51 Test #49: arrow-json-integration-test ..........   Passed    0.13 sec
      Start 50: arrow-json-test
50/51 Test #50: arrow-json-test ......................   Passed    0.26 sec
      Start 51: arrow-orc-adapter-test
51/51 Test #51: arrow-orc-adapter-test ...............   Passed    1.92 sec

98% tests passed, 1 tests failed out of 51

Label Time Summary:
arrow-tests      =  27.38 sec (27 tests)
arrow_compute    =  45.11 sec (14 tests)
arrow_dataset    =   1.21 sec (7 tests)
arrow_ipc        =   6.20 sec (3 tests)
unittest         =  79.91 sec (51 tests)

Total Test time (real) =  79.99 sec

The following tests FAILED:
	 20 - arrow-utility-test (Failed)
Errors while running CTest
```

Closes #7142 from kiszk/ARROW-8754

Authored-by: Kazuaki Ishizaki <ishizaki@jp.ibm.com>
Signed-off-by: Sutou Kouhei <kou@clear-code.com>

zhztheplayer pushed a commit to zhztheplayer/arrow-1 that referenced this pull request

Aug 11, 2021
* fix out_of_range error in castTIMESTAMP_date32

* support unix_date_seconds

* castDATE_nullsafe_utf8

* fix castTIMESTAMP_utf8 exception on milliseconds

* make castTIMESTAMP_withCarrying to be null-safe

zhztheplayer pushed a commit to zhztheplayer/arrow-1 that referenced this pull request

Feb 8, 2022
* fix out_of_range error in castTIMESTAMP_date32

* support unix_date_seconds

* castDATE_nullsafe_utf8

* fix castTIMESTAMP_utf8 exception on milliseconds

* make castTIMESTAMP_withCarrying to be null-safe

zhztheplayer pushed a commit to zhztheplayer/arrow-1 that referenced this pull request

Mar 3, 2022
* fix out_of_range error in castTIMESTAMP_date32

* support unix_date_seconds

* castDATE_nullsafe_utf8

* fix castTIMESTAMP_utf8 exception on milliseconds

* make castTIMESTAMP_withCarrying to be null-safe

rui-mo added a commit to rui-mo/arrow-1 that referenced this pull request

Mar 23, 2022
* fix out_of_range error in castTIMESTAMP_date32

* support unix_date_seconds

* castDATE_nullsafe_utf8

* fix castTIMESTAMP_utf8 exception on milliseconds

* make castTIMESTAMP_withCarrying to be null-safe

jayhomn-bitquill referenced this pull request in Bit-Quill/arrow

Aug 10, 2022
* Add toString to Time obj in Time#toString

* Improve Time toString

* Fix maven plugins

* Revert "Update java/flight/flight-jdbc-driver/src/test/java/org/apache/arrow/driver/jdbc/accessor/impl/calendar/ArrowFlightJdbcTimeStampVectorAccessorTest.java"

This reverts commit 00808c0.

* Revert "Merge pull request #29 from rafael-telles/Timestamp_fix"

This reverts commit 7924e7b, reversing
changes made to f6ac593.

* Fix DateTime for negative epoch

* Remove unwanted change

* Fix negative timestamp shift

* Fix coverage

* Refator DateTimeUtilsTest

GerHobbelt pushed a commit to GerHobbelt/arrow that referenced this pull request

Oct 18, 2024
* DX-67209 updated aes_encrypt/decrypt

GerHobbelt pushed a commit to GerHobbelt/arrow that referenced this pull request

Dec 14, 2024
* DX-67209 updated aes_encrypt/decrypt

paddyroddy referenced this pull request in rok/arrow

Jul 19, 2025
* Fix types in FlightDescriptor class

* Add argument types

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 20, 2026

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 20, 2026
Task apache#29 (ClearCachedMetadata) was already implemented in previous sessions:
- Implementation in file_orc.cc lines 803-812
- Test coverage in file_orc_test.cc (CachedMetadata test)
- Properly invalidates metadata, manifest, and statistics cache
- Thread-safe with mutex protection

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 20, 2026
…cumentation complete (apache#72)

Session 15 Achievements:
- Verified Task apache#29 (ClearCachedMetadata) already implemented and tested
- Completed Task apache#30 (Documentation) - 153 lines of comprehensive inline docs
- All key functions now documented with spec references and Parquet patterns
- Maintainability significantly improved

Project Status: 87% complete (33 of 38 tasks)
- P0: 100% complete (19/19) ✓
- P1: 100% complete (12/12) ✓
- P2: 17% complete (1/6)
- P3: 100% complete (1/1) ✓

Core feature is PRODUCTION-READY with full test coverage and documentation!

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 24, 2026

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 24, 2026
Task apache#29 (ClearCachedMetadata) was already implemented in previous sessions:
- Implementation in file_orc.cc lines 803-812
- Test coverage in file_orc_test.cc (CachedMetadata test)
- Properly invalidates metadata, manifest, and statistics cache
- Thread-safe with mutex protection

cbb330 added a commit to cbb330/arrow that referenced this pull request

Feb 24, 2026
…cumentation complete (apache#72)

Session 15 Achievements:
- Verified Task apache#29 (ClearCachedMetadata) already implemented and tested
- Completed Task apache#30 (Documentation) - 153 lines of comprehensive inline docs
- All key functions now documented with spec references and Parquet patterns
- Maintainability significantly improved

Project Status: 87% complete (33 of 38 tasks)
- P0: 100% complete (19/19) ✓
- P1: 100% complete (12/12) ✓
- P2: 17% complete (1/6)
- P3: 100% complete (1/1) ✓

Core feature is PRODUCTION-READY with full test coverage and documentation!