ARROW-3180: [C++] Add docker-compose setup to simulate Travis CI run locally by kszucs · Pull Request #2572 · apache/arrow

@kszucs added WIP

PR is work in progress

and removed WIP

PR is work in progress

labels

Sep 16, 2018

wesm

wesm approved these changes Sep 29, 2018

kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

@kszucs

Change-Id: I355c38a0aac222a000a471674a43af95ab802989

@kszucs

@kszucs

@kszucs

kszucs pushed a commit that referenced this pull request

Nov 18, 2018
Thank you to @romainfrancois and others who have pushed forward the R side of this project!

This PR is my attempt to address [ARROW-3336](https://issues.apache.org/jira/projects/ARROW/issues/ARROW-3366), providing a testing container for the R package.

This follows up on work done by @kszucs in #2572 in an R-specific way.

**NOTE:**  This PR is a WIP. `R CMD INSTALL` currently fails because it cannot find wherever I installed `arrow` to. But I felt that this is far enough along to put up for review.

Author: James Lamb <jaylamb20@gmail.com>
Author: Krisztián Szűcs <szucs.krisztian@gmail.com>

Closes #2770 from jameslamb/r_dockerfile and squashes the following commits:

9fcebe5 <James Lamb> removed failing test in the R package
dd26d4b <James Lamb> fixed failing test in the R package
343456a <James Lamb> more changes
0db3369 <James Lamb> added bit64 dependency to R package
f7c050e <Krisztián Szűcs> R_CHECK_FORCE_SUGGESTS
db9ee5b <Krisztián Szűcs> pass CXXFLAGS
8a8376d <James Lamb> Put R build steps into a separate CI script
64ea840 <James Lamb> Updated LD_LIBRARY_PATH in R container
4d7f02c <James Lamb> fixed a few issues in R container
94242b3 <James Lamb> Add explict cpp build in usage for R docker-compose
4a7112b <James Lamb> Fixed comment text in R Dockerfile
d8e55d7 <James Lamb> removed todo about R containers in docker-compose
210a774 <James Lamb> ARROW-3366:  Dockerfile for docker-compose setup

This was referenced

Mar 14, 2019

pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request

Oct 24, 2025
…locally

Also resolves:

> ARROW-3078: [Python] Docker integration tests should not contaminate the local Python development environment

Working:
- [x] rust
- [x] go
- [x] c_glib
- [x] ruby
- [x] java
- [x] cpp
- [x] python
- [x] hdfs integration

The rest:
- js (gulp error...)
- matlab
- R
- dask integration
- spark integration
- gen_apidocs
- hiveserver2
- iwyu

Perhaps resolve them in follow-up PRs.

Author: Krisztián Szűcs <szucs.krisztian@gmail.com>
Author: Wes McKinney <wesm+git@apache.org>

Closes apache#2572 from kszucs/ARROW-3180 and squashes the following commits:

41cd810 <Krisztián Szűcs> shm_size
c3b73e7 <Krisztián Szűcs> set shm_size
83929c9 <Krisztián Szűcs>  remove js lock files from dockerignore
52c0d89 <Wes McKinney> Add glog to C++ env
5074cf5 <Krisztián Szűcs>  add integration data to java image
8ea75a6 <Krisztián Szűcs>  java docker image
0d11fc6 <Krisztián Szűcs> organize js dockerfile
4503116 <Krisztián Szűcs> improve layer caching
a5385ad <Krisztián Szűcs> update dockerignore to reduce the build context's size
e287919 <Krisztián Szűcs> meson install c_glib; run ruby tests
210d4eb <Krisztián Szűcs> c_glib dockerfile
09a3e6f <Krisztián Szűcs> js dockerfile
9e51cb9 <Krisztián Szűcs> mixed whitespaces in python Dockerfile
c8d3f26 <Krisztián Szűcs> mixed whitespaces in cpp Dockerfile
99ce42e <Krisztián Szűcs> mixed whitespaces in hdfs Dockerfile
f505105 <Krisztián Szűcs> missing license headers
26fe1f6 <Krisztián Szűcs> license headers
1737ef4 <Krisztián Szűcs> comment fixes
2900810 <Krisztián Szűcs> docker-compose setup; go, rust, cpp, python, hdfs-integration