mirror of
https://github.com/BurntSushi/ripgrep.git
synced 2025-05-18 17:20:21 -07:00
ripgrep began it's life with docopt for argument parsing. Then it moved to Clap and stayed there for a number of years. Clap has served ripgrep well, and it probably could continue to serve ripgrep well, but I ended up deciding to move off of it. Why? The first time I had the thought of moving off of Clap was during the 2->3->4 transition. I thought the 3.x and 4.x releases were great, but for me, it ended up moving a little too quickly. Since the release of 4.x was telegraphed around when 3.x came out, I decided to just hold off and wait to migrate to 4.x instead of doing a 3.x migration followed shortly by another 4.x migration. Of course, I just never ended up doing the migration at all. I never got around to it and there just wasn't a compelling reason for me to upgrade. While I never investigated it, I saw an upgrade as a non-trivial amount of work in part because I didn't encapsulate the usage of Clap enough. The above is just what got me started thinking about it. It wasn't enough to get me to move off of it on its own. What ended up pushing me over the edge was a combination of factors: * As mentioned above, I didn't want to run on the migration treadmill. This has proven to not be much of an issue, but at the time of the 2->3->4 releases, I didn't know how long Clap 4.x would be out before a 5.x would come out. * The release of lexopt[1] caught my eye. IMO, that crate demonstrates exactly how something new can arrive on the scene and just thoroughly solve a problem minimalistically. It has the docs, the reasoning, the simple API, the tests and good judgment. It gets all the weird corner cases right that Clap also gets right (and is part of why I was originally attracted to Clap). * I have an overall desire to reduce the size of my dependency tree. In part because a smaller dependency tree tends to correlate with better compile times, but also in part because it reduces my reliance and trust on others. It lets me be the "master" of ripgrep's destiny by reducing the amount of behavior that is the result of someone else's decision (whether good or bad). * I perceived that Clap solves a more general problem than what I actually need solved. Despite the vast number of flags that ripgrep has, its requirements are actually pretty simple. We just need simple switches and flags that support one value. No multi-value flags. No sub-commands. And probably a lot of other functionality that Clap has that makes it so flexible for so many different use cases. (I'm being hand wavy on the last point.) With all that said, perhaps most importantly, the future of ripgrep possibly demands a more flexible CLI argument parser. In today's world, I would really like, for example, flags like `--type` and `--type-not` to be able to accumulate their repeated values into a single sequence while respecting the order they appear on the CLI. For example, prior to this migration, `rg regex-automata -Tlock -ttoml` would not return results in `Cargo.lock` in this repository because the `-Tlock` always took priority even though `-ttoml` appeared after it. But with this migration, `-ttoml` now correctly overrides `-Tlock`. We would like to do similar things for `-g/--glob` and `--iglob` and potentially even now introduce a `-G/--glob-not` flag instead of requiring users to use `!` to negate a glob. (Which I had done originally to work-around this problem.) And some day, I'd like to add some kind of boolean matching to ripgrep perhaps similar to how `git grep` does it. (Although I haven't thought too carefully on a design yet.) In order to do that, I perceive it would be difficult to implement correctly in Clap. I believe that this last point is possible to implement correctly in Clap 2.x, although it is awkward to do so. I have not looked closely enough at the Clap 4.x API to know whether it's still possible there. In any case, these were enough reasons to move off of Clap and own more of the argument parsing process myself. This did require a few things: * I had to write my own logic for how arguments are combined into one single state object. Of course, I wanted this. This was part of the upside. But it's still code I didn't have to write for Clap. * I had to write my own shell completion generator. * I had to write my own `-h/--help` output generator. * I also had to write my own man page generator. Well, I had to do this with Clap 2.x too, although my understanding is that Clap 4.x supports this. With that said, without having tried it, my guess is that I probably wouldn't have liked the output it generated because I ultimately had to write most of the roff by hand myself to get the man page I wanted. (This also had the benefit of dropping the build dependency on asciidoc/asciidoctor.) While this is definitely a fair bit of extra work, it overall only cost me a couple days. IMO, that's a good trade off given that this code is unlikely to change again in any substantial way. And it should also allow for more flexible semantics going forward. Fixes #884, Fixes #1648, Fixes #1701, Fixes #1814, Fixes #1966 [1]: https://docs.rs/lexopt/0.3.0/lexopt/index.html
211 lines
7.2 KiB
YAML
211 lines
7.2 KiB
YAML
name: ci
|
|
on:
|
|
pull_request:
|
|
push:
|
|
branches:
|
|
- master
|
|
schedule:
|
|
- cron: '00 01 * * *'
|
|
|
|
# The section is needed to drop write-all permissions that are granted on
|
|
# `schedule` event. By specifying any permission explicitly all others are set
|
|
# to none. By using the principle of least privilege the damage a compromised
|
|
# workflow can do (because of an injection or compromised third party tool or
|
|
# action) is restricted. Currently the worklow doesn't need any additional
|
|
# permission except for pulling the code. Adding labels to issues, commenting
|
|
# on pull-requests, etc. may need additional permissions:
|
|
#
|
|
# Syntax for this section:
|
|
# https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#permissions
|
|
#
|
|
# Reference for how to assign permissions on a job-by-job basis:
|
|
# https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs
|
|
#
|
|
# Reference for available permissions that we can enable if needed:
|
|
# https://docs.github.com/en/actions/security-guides/automatic-token-authentication#permissions-for-the-github_token
|
|
permissions:
|
|
# to fetch code (actions/checkout)
|
|
contents: read
|
|
|
|
jobs:
|
|
test:
|
|
name: test
|
|
env:
|
|
# For some builds, we use cross to test on 32-bit and big-endian
|
|
# systems.
|
|
CARGO: cargo
|
|
# When CARGO is set to CROSS, this is set to `--target matrix.target`.
|
|
# Note that we only use cross on Linux, so setting a target on a
|
|
# different OS will just use normal cargo.
|
|
TARGET_FLAGS:
|
|
# When CARGO is set to CROSS, TARGET_DIR includes matrix.target.
|
|
TARGET_DIR: ./target
|
|
# Bump this as appropriate. We pin to a version to make sure CI
|
|
# continues to work as cross releases in the past have broken things
|
|
# in subtle ways.
|
|
CROSS_VERSION: v0.2.5
|
|
# Emit backtraces on panics.
|
|
RUST_BACKTRACE: 1
|
|
runs-on: ${{ matrix.os }}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
include:
|
|
- build: pinned
|
|
os: ubuntu-latest
|
|
rust: 1.74.0
|
|
- build: stable
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
- build: beta
|
|
os: ubuntu-latest
|
|
rust: beta
|
|
- build: nightly
|
|
os: ubuntu-latest
|
|
rust: nightly
|
|
- build: stable-musl
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
target: x86_64-unknown-linux-musl
|
|
- build: stable-x86
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
target: i686-unknown-linux-gnu
|
|
- build: stable-aarch64
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
target: aarch64-unknown-linux-gnu
|
|
- build: stable-powerpc64
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
target: powerpc64-unknown-linux-gnu
|
|
- build: stable-s390x
|
|
os: ubuntu-latest
|
|
rust: stable
|
|
target: s390x-unknown-linux-gnu
|
|
- build: macos
|
|
os: macos-latest
|
|
rust: nightly
|
|
- build: win-msvc
|
|
os: windows-2022
|
|
rust: nightly
|
|
- build: win-gnu
|
|
os: windows-2022
|
|
rust: nightly-x86_64-gnu
|
|
steps:
|
|
- name: Checkout repository
|
|
uses: actions/checkout@v4
|
|
|
|
- name: Install packages (Ubuntu)
|
|
if: matrix.os == 'ubuntu-latest'
|
|
run: |
|
|
ci/ubuntu-install-packages
|
|
|
|
- name: Install packages (macOS)
|
|
if: matrix.os == 'macos-latest'
|
|
run: |
|
|
ci/macos-install-packages
|
|
|
|
- name: Install Rust
|
|
uses: dtolnay/rust-toolchain@master
|
|
with:
|
|
toolchain: ${{ matrix.rust }}
|
|
|
|
- name: Use Cross
|
|
if: matrix.os == 'ubuntu-latest' && matrix.target != ''
|
|
run: |
|
|
# In the past, new releases of 'cross' have broken CI. So for now, we
|
|
# pin it. We also use their pre-compiled binary releases because cross
|
|
# has over 100 dependencies and takes a bit to compile.
|
|
dir="$RUNNER_TEMP/cross-download"
|
|
mkdir "$dir"
|
|
echo "$dir" >> $GITHUB_PATH
|
|
cd "$dir"
|
|
curl -LO "https://github.com/cross-rs/cross/releases/download/$CROSS_VERSION/cross-x86_64-unknown-linux-musl.tar.gz"
|
|
tar xf cross-x86_64-unknown-linux-musl.tar.gz
|
|
echo "CARGO=cross" >> $GITHUB_ENV
|
|
echo "TARGET_FLAGS=--target ${{ matrix.target }}" >> $GITHUB_ENV
|
|
echo "TARGET_DIR=./target/${{ matrix.target }}" >> $GITHUB_ENV
|
|
|
|
- name: Show command used for Cargo
|
|
run: |
|
|
echo "cargo command is: ${{ env.CARGO }}"
|
|
echo "target flag is: ${{ env.TARGET_FLAGS }}"
|
|
echo "target dir is: ${{ env.TARGET_DIR }}"
|
|
|
|
- name: Build ripgrep and all crates
|
|
run: ${{ env.CARGO }} build --verbose --workspace ${{ env.TARGET_FLAGS }}
|
|
|
|
- name: Build ripgrep with PCRE2
|
|
run: ${{ env.CARGO }} build --verbose --workspace --features pcre2 ${{ env.TARGET_FLAGS }}
|
|
|
|
# This is useful for debugging problems when the expected build artifacts
|
|
# (like shell completions and man pages) aren't generated.
|
|
- name: Show build.rs stderr
|
|
shell: bash
|
|
run: |
|
|
set +x
|
|
stderr="$(find "${{ env.TARGET_DIR }}/debug" -name stderr -print0 | xargs -0 ls -t | head -n1)"
|
|
if [ -s "$stderr" ]; then
|
|
echo "===== $stderr ===== "
|
|
cat "$stderr"
|
|
echo "====="
|
|
fi
|
|
set -x
|
|
|
|
- name: Run tests with PCRE2 (sans cross)
|
|
if: matrix.target == ''
|
|
run: ${{ env.CARGO }} test --verbose --workspace --features pcre2 ${{ env.TARGET_FLAGS }}
|
|
|
|
- name: Run tests without PCRE2 (with cross)
|
|
# These tests should actually work, but they almost double the runtime.
|
|
# Every integration test spins up qemu to run 'rg', and when PCRE2 is
|
|
# enabled, every integration test is run twice: one with the default
|
|
# regex engine and once with PCRE2.
|
|
if: matrix.target != ''
|
|
run: ${{ env.CARGO }} test --verbose --workspace ${{ env.TARGET_FLAGS }}
|
|
|
|
- name: Test zsh shell completions (Unix, sans cross)
|
|
# We could test this when using Cross, but we'd have to execute the
|
|
# 'rg' binary (done in test-complete) with qemu, which is a pain and
|
|
# doesn't really gain us much. If shell completion works in one place,
|
|
# it probably works everywhere.
|
|
if: matrix.target == '' && matrix.os != 'windows-2022'
|
|
shell: bash
|
|
run: ci/test-complete
|
|
|
|
- name: Print hostname detected by grep-cli crate
|
|
shell: bash
|
|
run: ${{ env.CARGO }} test --manifest-path crates/cli/Cargo.toml ${{ env.TARGET_FLAGS }} --lib print_hostname -- --nocapture
|
|
|
|
- name: Print available short flags
|
|
shell: bash
|
|
run: ${{ env.CARGO }} test --bin rg ${{ env.TARGET_FLAGS }} flags::defs::tests::available_shorts -- --nocapture
|
|
|
|
rustfmt:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- name: Checkout repository
|
|
uses: actions/checkout@v4
|
|
- name: Install Rust
|
|
uses: dtolnay/rust-toolchain@master
|
|
with:
|
|
toolchain: stable
|
|
components: rustfmt
|
|
- name: Check formatting
|
|
run: cargo fmt --all --check
|
|
|
|
docs:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- name: Checkout repository
|
|
uses: actions/checkout@v4
|
|
- name: Install Rust
|
|
uses: dtolnay/rust-toolchain@master
|
|
with:
|
|
toolchain: stable
|
|
- name: Check documentation
|
|
env:
|
|
RUSTDOCFLAGS: -D warnings
|
|
run: cargo doc --no-deps --document-private-items --workspace
|