OpenEnroth 63eb83e
Loading...
Searching...
No Matches
Development HOWTO

This document describes the development process we're following. It's required reading for anyone intending to contribute.

Dependencies

Main dependencies:

By default, we are using prebuilt dependencies, and they are resolved automatically during the cmake phase.

Additional dependencies:

Minimum required compiler versions are as follows:

  • Visual Studio 2022;
  • GCC 13;
  • AppleClang 15 or Clang 15.

The following IDEs have been tested and should work fine:

  • Visual Studio (2022 or later);
  • Visual Studio Code (2022 or later);
  • CLion (2022 or later).

Building on *nix platforms

This project uses the CMake build system. Use the following commands to clone the repository and build OpenEnroth:

$ git clone --recurse-submodules --shallow-submodules https://github.com/OpenEnroth/OpenEnroth.git
$ cd OpenEnroth
$ cmake -B build -S . -DCMAKE_BUILD_TYPE=Debug
$ cmake --build build

To cross-compile for 32-bit x86, you can pass -m32 via compiler flags to cmake. In the snipped above that would mean running export CFLAGS="-m32" CXXFLAGS="-m32" first.

You can also select platform dependent generator for your favorite IDE.

Additional Notes for MacOS

  • Make sure you have the latest Xcode installed. Do this through the App Store or by downloading it from the Apple Developer website.

Building on Windows

  • Get git (https://git-scm.com/download/win) and Visual Studio 2022.
  • Make sure you have Windows SDK v10.0.20348.0 or higher.
  • Clone, fork or download the repo https://github.com/OpenEnroth/OpenEnroth.
  • Setup CMake:
    • either install standalone cmake from the official website,
    • or add Microsoft one (that's coming with the VS installation) to your PATH environment variable (e.g c:\Program Files\Microsoft Visual Studio\2022\<edition>\Common7\IDE\CommonExtensions\Microsoft\CMake\CMake\bin).
  • Open the folder in Visual Studio.
  • Select build configuration (x32 or x64) and wait for CMake configuration to complete.
  • Select startup item as OpenEnroth.exe.
  • Run!

If you wish you can also disable prebuilt dependencies by turning off OE_USE_PREBUILT_DEPENDENCIES cmake option and pass your own dependencies source, e.g. via vcpkg integration.

Be aware that Visual Studio has a bug with git submodules not syncing between branches. So when checking out the branch or switching to different branch you may need to run the following command manually: git submodule update --init

Coding style

For the C++ code we are following the Google C++ Style Guide. Source code is automatically checked against it and pull request will fail if you don't follow it.

To perform a style check before pushing anything you can build check_style target. In Visual Studio you can do that by going to Solution Explorer → Change Views → CMake targets. Right click and build check_style, errors will be listed in output.

We also follow some additional style preferences, as listed below.

Documentation:

  • Documentation should be in doxydoc format with @ used for tags, and starting with /** comment introducer.
  • Documentation should be written in English.
  • Please leave original function offsets intact. If you have a chance, move them to doxygen comments using @par Original binary offset:\ilinebr doxygen tag (e.g. @par Original binary offset:\ilinebr 0xCAFEBEEF).

Naming:

  • Use MM_ prefix for macro naming. Macro names should be in SNAKE_CASE_ALL_CAPS.
  • Use SNAKE_CASE_ALL_CAPS for enum values. E.g. ITEM_CRATE_OF_ARROWHEADS, ITEM_SLOT_RING6.
  • For naming enum values, prefix the name with the name of the type, e.g. MONSTER_TROLL_A for a value of enum class MonsterId. For values that are then used in array bounds, put the _FIRST, _LAST and _COUNT right after the name of the type, e.g. ITEM_FIRST_MESSAGE_SCROLL.
  • Use CamelCase for everything else.
  • Type names should start with a capital letter. E.g. IndexedArray, InputAction, LogLevel. This applies to all types, including classes, structs, enums and typedefs, with certain exceptions as listed below.
  • Method & function names should start with a lowercase letter. E.g. Vec3::length, gridCellToWorldPosX, ceilingHeight.
  • Variable names should start with a lowercase letter. E.g. int monsterCount = level->monsterCount().
  • Names of private members should start with an underscore to visually distinguish them from variables without having to spell out this-> every single time. E.g. _initialized = true, where _initialized is a member field.
  • Note that the above doesn't apply to POD-like types as for such types all members are public and are named just like ordinary variables.
  • Exceptions to the rules above are STL-compatible interfaces, which should follow STL naming rules. So it's value_type for iterator value type, and push_back for a method that's adding an element to a container.

Code formatting:

  • * and & in type declarations should be preceded by a space. So it's char *string, and not char* string.

Language features:

  • Use using Alias = Type instead of typedef Type Alias.
  • Use enum classes followed by using enum statements instead of ordinary enums. This provides type safety without changing the syntax. For flags, use Flags class.
  • It's OK to use plain enums if you really need to have implicit casts to integer types, but this is a very rare use case. If you're using enum values to index into some array, consider using enum class coupled with IndexedArray.
  • Make your code speak for itself when it comes to ownership. If a function takes ownership of one of its parameters, it should take std::unique_ptr by value. If it allocates its result and passes ownership to the caller, then it should return std::unique_ptr.
  • Use an int unless you need something else. Don’t try to avoid negative values by using unsigned, this implies many changes to the usual behavior of integers and can be a source of bugs. See a section in core guidelines for more info. However, don't overdo it, use size_t for indexing into STL containers.
  • For string function parameters, use std::string_view passed by value.
    • In general, you shouldn't bother optimizing code paths where you might save an allocation by moving in an std::string or passing it by const reference, the performance benefits are almost always negligible.
    • Use TransparentString* classes if you need to index into a string map using std::string_view keys.
    • However, feel free to use std::string or const std::string & parameters where it makes your code simpler (e.g. by avoiding jumping through hoops if you'll need to create an intermediate std::string object anyway).
    • C++ is notoriously bad when it comes to string concatenation (you can't concatenate std::string_view with a string literal using operator+, and never will). In most cases you should be fine just using fmt::format for this. If fmt::format looks like an overkill, use join from Utility/String/Transformations.h.
  • We generally refrain from using namespaces because OpenEnroth is a relatively small codebase, and we don't need the measures advocated by the Google style guide to prevent name clashes.
    • We don't put user-facing classes into namespaces because it ultimately leads to code where you have ns1::Context and ns2::Context, and when coupled with a bit of using here and there this makes the code harder to read and reason about. Please spend some time coming up with good names for your classes instead.
    • We sometimes use namespaces to group related functions, e.g. see namespace lod.
    • Exception is namespace detail that you're encouraged to use to hide implementation details and to prevent cluttering of the global namespace.
  • std::strings in the code are assumed to be UTF8-encoded as advised by utf8everywhere. On Windows this is ensured by the UnicodeCrt class that sets up the standard library to use UTF8 encoding. Thus, you don't need to bother with std::u8string, and you can safely convert std::filesystem::path to string by calling path.string().
    • This is not yet true for in-game strings. E.g. strings for the Russian localization are in CP1251.

Error handling:

  • Use asserts to check for coding errors and conditions that must never be false, no matter how the program is run.
  • Use exceptions for non-recoverable errors. It's usually OK to just throw an instance of class Exception.
  • Use Logger for warnings and recoverable errors.
  • We don't yet have a mechanism for displaying errors to the user through the UI. This document will be updated once this is implemented.

There is a lot of code in the project that doesn't follow these conventions. Please feel free to fix it, preferably not mixing up style and logical changes in the same PR.

Code Organization

OpenEnroth code is broken up as follows:

  • thirdparty – this is where all external libraries go.
  • Utility – generic utility classes and functions go here. Utility classes should be domain-independent (e.g. should make sense in a context of some other project) and should depend only on thirdparty libraries.
  • Library – collection of independent libraries that the engine is built on top of. Code here can depend on Utility and other libraries in Library. However, there should be no cyclical dependencies between libraries here.
  • Library/Platform is our platform abstraction layer on top of SDL.
  • The rest of the code is currently pretty tangled with each part depending on each other. This document will be updated once we have some progress there.

Our basic guidelines for code organization are:

  • One CMakeLists.txt file per folder. Exceptions are /android, /CMakeModules and /resources.
  • One class per source file, with the name of the source file matching the name of the class. Exceptions are small structs, which are usually easier to pack into a single source file, and helper classes, which generally should stay next to the main class. Note that this guideline doesn't apply to source files that mainly declare functions.

Testing

We strive for a good test coverage of the project, and while we're not there yet, the current policy is to add tests for all the bugs we fix, as long as the fix is testable. E.g. graphical glitches are generally very hard to test, but we have the infrastructure to test game logic and small isolated classes.

Tests in OpenEnroth fall into two categories:

  • Unit tests. These are a standard breed of tests, written using Google Test. You can see some examples in src/Utility/Tests.
  • Game tests. If you're familiar with how testing is done these days for complex mobile apps, then you can consider game tests a variation of UI tests that's specific to our project. Game tests need game assets to run.

Game tests work by instrumenting the engine, and then running test code in between the game frames. This code usually sends events to the engine (e.g. mouse clicks), which are then processed by the engine in the next frame, but it can do pretty much anything else – all of engine's data is accessible and writable from inside the game test.

As typing out all the events to send inside the test code can be pretty tedious, we also have an event recording functionality, so that the test creation workflow usually looks as follows:

  • Fix the bug.
  • Load a save that used to reproduce the bug that you've just fixed.
  • Press Ctrl+Shift+R to start recording an event trace. Check logs to make sure that trace recording has started.
  • Perform the steps that used to reproduce the bug.
  • Press Ctrl+Shift+R again to stop trace recording. You will get two files generated in the current folder – trace.json and trace.mm7.
  • Rename them into something more suiting (e.g. issue_XXX.json and issue_XXX.mm7) and create a PR to the OpenEnroth_TestData repo.
  • Once it's merged update the reference tag in the corresponding CMakeLists.txt in the main repo.
  • Create a new test case in one of the game test files in the game tests folder.
  • Use TestController::playTraceFromTestData to play back your trace, and add the necessary checks around it.

If you need to record a trace with non-standard FPS (e.g. if an issue doesn't reproduce on lower FPS values), set debug.trace_frame_time_ms config value before starting OpenEnroth for recording.

To run all unit tests locally, build a OpenEnroth_UnitTest cmake target and run <build-dir>/test/Bin/UnitTest/OpenEnroth_UnitTest.

To run all game tests locally, set OPENENROTH_MM7_PATH environment variable to point to the location of the game assets, then build Run_GameTest_Headless_Parallel cmake target. Alternatively, you can build OpenEnroth_GameTest, and run it manually, passing the paths to both game assets and the test data via command line. Run OpenEnroth_GameTest --help for a list of options. Note that you can pass --headless to run tests in headless mode. You can use the test data from <build-dir>/test/Bin/test_data/data, which is automatically downloaded and updated by the OpenEnroth_TestData cmake target. Alternatively, if you cloned the OpenEnroth_TestData repository, you can use that.

If you need to look closely at the recorded trace, you can play it by running OpenEnroth play --speed 0.5 <path-to-trace.json>. Alternatively, if you already have a unit test that runs the recorded trace, you can run OpenEnroth_GameTest --speed 0.5 --gtest_filter=<test-suite-name>.<test-name> --test-path <path-to-test-data-folder>. Note that --gtest_filter needs that = and won't work if you try passing the test name after a space.

How to deal with <tt>Random state desynchronized</tt>

Changing game logic might result in failures in game tests because they check the random number generator state after each frame, and this will show as Random state desynchronized when playing back trace message in test logs. This is intentional – we don't want accidental game logic changes. If the change was actually intentional, then you will need to either retrace or re-record the traces for the failing tests as follows. These instructions assume your change is already submitted as PR backed from your fork, or will be.

  • Prepare to submit a PR to the OpenEnroth_TestData repo: Fork and clone it if you haven't done so already.
  • Reminder: Make sure your test data clone is up to date and has no uncommitted local changes, and create a branch.
  • To retrace, run OpenEnroth retrace <path-to-trace.json>. Note that you can pass multiple trace paths to this command. Use paths into your clone of the test data (if you retrace the copies in <build-dir>/test/Bin/test_data/data you'll need to copy them over).
  • Commit, push and PR the changes made by the retrace to OpenEnroth_TestData.
  • Back in the main OpenEnroth clone, paste the commit hash into the GIT_TAG key in test/Bin/CMakeLists.txt, replacing the one already there, and update the GIT_REPOSITORY to point to your clone of OpenEnroth_TestData.
  • Commit this to your main PR's branch and push it. The checks this push triggers should now succeed.

Scripting

We're using Lua as the scripting language, and all our scripts are currently located under the resources/scripts folder.

Lua Language Server

Script files undergo a syntax checking process during the build generation. If you intend to work with scripts, it is recommended to install the Lua Language Server to run the style checker locally. Follow these steps to setup LuaLS locally:

  • Install LuaLS through one of the following methods. Ensure that the lua-language-server executable is available in the PATH environment variable.
  • Generate the project.
  • The check_style target is now including scripting in its tests.

Little note: If LuaLS is not found, everything still build but no checks will be run against the Lua scripts.

Tools

To go through a better experience while working with scripts it is strongly recommended to use VS Code and install the LuaLS extension. Just be sure to open the root repository folder in VS Code. By doing so LuaLS reads the correct configuration file used by the project

Modding ?

Scripting is currently used only for debugging purposes. Modding support is not planned for the near future. You can check the milestones to get a better idea.

Console Commands

The game features a console capable of executing various Lua script commands. To activate this feature, please follow these steps:

  1. Launch the game.
  2. Begin by loading an existing game or creating a new one.
  3. Once in-game, press the ~ key to open the debug console.

Currently, the console is only available while in-game.

Additional Resources

Old event decompiler and IDB files can be found here. Feel free to ping zipi#6029 on Discord for more info.

Support

Still having problems? Ask for help on our discord!

Generated by doxygen 1.9.5