Skip to content

Commit

Permalink
Add CMake rule for gen_fake_data (#1737)
Browse files Browse the repository at this point in the history
Summary:
Pull Request resolved: #1737

# This stack
* Create a gen_fake_data script using C++ since the Python one takes ~12hr to process 1B rows
# This diff
* Add CMake rule so this binary is buildable in OSS

Reviewed By: marksliva

Differential Revision: D40386169

fbshipit-source-id: 573866ecfc1d0563064f7760aa3432db4bdbc216
  • Loading branch information
Logan Gore authored and facebook-github-bot committed Oct 19, 2022
1 parent 6afbb2b commit 4b1a8c9
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 0 deletions.
12 changes: 12 additions & 0 deletions docker/data_processing/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -135,3 +135,15 @@ target_link_libraries(
idcombiner
perftools)
install(TARGETS attribution_id_combiner DESTINATION bin)

# GenFakeData utility
find_package(gflags REQUIRED)
add_executable(
gen_fake_data
"fbpcs/data_processing/load_testing_utils/FakeDataGenerator.cpp"
"fbpcs/data_processing/load_testing_utils/GenFakeData.cpp")
target_link_libraries(
gen_fake_data
gflags
)
install(TARGETS gen_fake_data DESTINATION bin)
1 change: 1 addition & 0 deletions docker/data_processing/Dockerfile.ubuntu
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ COPY fbpcs/data_processing/id_combiner/ ./fbpcs/data_processing/id_combiner
COPY fbpcs/data_processing/lift_id_combiner/ ./fbpcs/data_processing/lift_id_combiner
COPY fbpcs/data_processing/pid_preparer/ ./fbpcs/data_processing/pid_preparer
COPY fbpcs/data_processing/sharding/ ./fbpcs/data_processing/sharding
COPY fbpcs/data_processing/load_testing_utils/ ./fbpcs/data_processing/load_testing_utils

RUN cmake . -DTHREADING=ON -DEMP_USE_RANDOM_DEVICE=ON
RUN make && make install
Expand Down

0 comments on commit 4b1a8c9

Please sign in to comment.