Category : apache-arrow

Example: Let’s say a table name user has id, name, email, phone, and is_active as attributes. And there are 1000s of users part of this table. I would like to read the details per user. void ParquetReaderPlus::read_next_row(long row_group_index, long local_row_num) { std::vector<int> columns_to_tabulate(this->total_row); for (int idx = 0; idx < this->total_row; idx++) columns_to_tabulate[idx] = idx; ..

Read more

I’m using conan to build a library that uses arrow parquet. I built arrow myself because I couldn’t find versions in conan center that included parquet: In my conanfile.txt [options] arrow:shared=True # I tried both shared and static arrow:parquet=True arrow:with_snappy=True conan install .. –build=arrow It builds and executes properly in my machine, but fails the ..

Read more

Here is a cmake snippet that I use to link to libpqxx library that is installed by vcpkg and try to use the apache-arrow that is installed by brew. find_package(libpqxx REQUIRED) target_link_libraries(database PRIVATE libpqxx::pqxx) find_package(Arrow CONFIG REQUIRED PATHS /usr/local/lib/cmake/arrow NO_DEFAULT_PATH) find_package(Parquet CONFIG REQUIRED PATHS /usr/local/lib/cmake/arrow NO_DEFAULT_PATH) target_link_libraries(database PRIVATE arrow_shared parquet_shared) To run it I use: ..

Read more