Finished Benchmarks

* Added matching benchmark

* Added utils functions for test/performance

* Added Boost benchmark

Author: Kalashnikovni

test/README.md

@@ -31,18 +31,24 @@ Measures and outputs execution time of predefined tests.
 The following benchmarks can be executed from the sb-graph/build/ directory
 with the following commands:
   - `make run-benchmark`: benchmark for some implementations of Sets and PWMaps.
+  - `make run-match`: benchmark for the maximum matching algorithm applied to
+    TestRL1.test, TestRL2.test and TestRL3.test.
   - `make run-scc`: benchmark for the SCC algorithm applied to TestRL1.test,
     TestRL2.test and TestRL3.test.
 
 In the ./test/build/bin there are also some helpful binaries:
   - boost-perf: used to evaluate the performance of traditional graphs
     algorithms.
+  - custom-match-benchmark: benchmark for the maximum matching algorithm applied
+    to a custom .test file. Environmental variables TEST_FILE, SET_IMPL and
+    PW_IMPL are support. So, for example,
+    `TEST_FILE="../../TestRL1.test" SET_IMPL="2" ./custom-match-benchmark` runs
+    the benchmark for TestRL1.test with the ordered unidimensional dense set
+    implementation.
   - custom-scc-benchmark: benchmark for the SCC algorithm applied to a custom
     .test file. Environmental variables TEST_FILE, SET_IMPL and PW_IMPL are
-    supported. So, for example,
-    `TEST_FILE="../../TestRL1.test" SET_IMP="2" ./custom-scc-benchmark` runs the
-    benchmark for TestRL1.test with the ordered unidimensional dense set
-    implementation.
-
-There are also some scripts in some subfolders, that will be deleted in the
-near future.
+    supported.
+  - custom-boost-benchmark: benchmark for the C++ Boost Graph Library
+    traditional scalar algorithms. This benchmark is introduced to compare
+    the SBG approach with existing techniques. Environmental variable TEST_FILE
+    is supported.

test/TestRL2.test

@@ -21,7 +21,7 @@ equation
 end TestRL2;
 */
 
-N = 1000000;
+N = 100000;
 
 F1 = N;
 F2 = N-1+F1;

test/TestRL3.test

@@ -22,7 +22,7 @@ equation
 end TestRL3;
 */
 
-N = 1000000;
+N = 100000;
 
 F1 = N;
 F2 = N-1+F1;

test/performance/CMakeLists.txt

@@ -1,4 +1,4 @@
-# SBG Benchmark
+# SBG Benchmark for different Set and PWMap implementations
 add_executable(sbg-benchmark benchmark_main.cpp)
 
 target_sources(sbg-benchmark
@@ -24,16 +24,6 @@ target_link_libraries(sbg-benchmark
                       sbg-dev
                       sbg-eval-lib)
 
-# SCC Benchmark
-add_executable(scc-benchmark benchmark_main.cpp scc/scc_bm.cpp)
-target_link_libraries(scc-benchmark PUBLIC benchmark::benchmark PRIVATE sbg-dev sbg-eval-lib)
-set_target_properties(scc-benchmark PROPERTIES RUNTIME_OUTPUT_DIRECTORY ${BIN_DIR})
-add_custom_target(run-scc
-    COMMAND cd ${BIN_DIR} && ./scc-benchmark
-)
-add_dependencies(run-scc scc-benchmark)
-
-# SCC Benchmark
-add_executable(custom-scc-benchmark benchmark_main.cpp scc/custom_scc_bm.cpp)
-target_link_libraries(custom-scc-benchmark PUBLIC benchmark::benchmark PRIVATE sbg-dev sbg-eval-lib)
-set_target_properties(custom-scc-benchmark PROPERTIES RUNTIME_OUTPUT_DIRECTORY ${BIN_DIR})
+add_subdirectory(boost)
+add_subdirectory(matching)
+add_subdirectory(scc)

test/performance/boost/CMakeLists.txt

@@ -1,36 +1,17 @@
-# Add executable
-add_executable(
-    boost-perf
-)
-
-target_sources(
-    boost-perf
-    PRIVATE
-        boost_exec.cpp
-        main.cpp
-        ordinary_graph.cpp    
-        ordinary_graph_builder.cpp
-)
-
-target_compile_options(boost-perf PRIVATE "-Wall")
-
-# Link the library
-target_link_libraries(boost-perf
-                      PRIVATE
-                      sbg-dev
-                      sbgraph
-                      sbg-eval-lib
-                      ${GOOGLE_TEST_LIB}
-                      ${GOOGLE_MOCK_LIB}
-                      pthread
-)
-
-target_include_directories(boost-perf PRIVATE ${GOOGLE_TEST_INCLUDE} ${PROJECT_SOURCE_DIR})
-
-target_link_directories(boost-perf PRIVATE ${GOOGLE_TEST_INSTALL}/lib)
-
-# Set output directory for executable
-set_target_properties(boost-perf PROPERTIES
-  RUNTIME_OUTPUT_DIRECTORY
-    ${BIN_DIR}
-)
+# Custom Boost Benchmark
+add_executable(custom-boost-benchmark)
+target_sources(custom-boost-benchmark
+  PRIVATE
+  ../benchmark_main.cpp
+  custom_boost_bm.cpp
+  ordinary_graph.cpp
+  ordinary_graph_builder.cpp
+  ../utils.cpp)
+target_link_libraries(custom-boost-benchmark
+  PUBLIC
+  benchmark::benchmark
+  PRIVATE
+  sbg-dev
+  sbg-eval-lib)
+set_target_properties(custom-boost-benchmark
+  PROPERTIES RUNTIME_OUTPUT_DIRECTORY ${BIN_DIR})