Execute(Parsing checkmake errors should work): runtime ale_linters/make/checkmake.vim silent file Makefile AssertEqual \ [ \ { \ 'bufnr': 42, \ 'lnum': 1, \ 'type': 'E', \ 'text': 'woops: an error has occurred', \ } \ ], \ ale_linters#make#checkmake#Handle(42, [ \ 'This shouldnt match', \ '1:woops:an error has occurred', \ ]) After: call ale#linter#Reset()