Need help for custom Format #891

f4b0 · 2021-07-28T11:25:02Z

f4b0
Jul 28, 2021

Hi,
i need support for the following log message format.

28-07-2021 07:47:47; Level: INFO; Message: 127.0.0.1 - - [28/Jul/2021 07:47:47] "GET /api/predictv2/e9390432c491ce202296c582644c63aed51727340ab4c3e53d008cb80c7cffb2 HTTP/1.1" 200 -; Location: _internal._log

I tried to parse it with the following code but i get errors

{
   "$schema": "https://lnav.org/schemas/format-v1.schema.json",
   "example_log" : {
       "title" : "Server Log",
       "description" : "Log format used for the Server.",
       "url" : "",
       "regex" : {
           "basic" : {
                   "pattern" : "^(?<timestamp>%d-%m-%Y %H:%M:%S); Level: (?<level>\\w+); Message: (?<body>.*); Location: (?<component>.*)$"
           }
       },
       "level-field" : "level",
       "level" : {
           "error" : "ERROR",
           "warning" : "WARNING",
           "info" : "INFO"
       },
       "value" : {
           "component" : {
               "kind" : "string",
               "identifier" : true
           }
       },
       "sample" : [
           {
               "line" : "28-07-2021 08:31:23; Level: INFO; Message: 127.0.0.1 - - [28/Jul/2021 08:31:23] \"PUT /api/predictv2/1c4c3cccfd2b6369eccd7f1d69a4dd167e63350769ebe96c4ea6c7a9899acab0 HTTP/1.1\" 200 -; Location: _internal._log"
           }
       ]
   }
}

When i try to install it i get the following message

warning:viscomServiceLnav.json:line 2
warning:  unexpected path --
warning:    /$schema
warning:  accepted paths --
warning:    /(?<format_name>\w+)/  -- The definition of a log file format.
info: installed: /home/ffuchsb/.lnav/formats/installed/example_log.json

and when i try to view the log i will get the following message:

warning:/home/ffuchsb/.lnav//formats/installed/example_log.json:line 2
warning:  unexpected path --
warning:    /$schema
warning:  accepted paths --
warning:    /(?<format_name>\w+)/  -- The definition of a log file format.
error:example_log:invalid sample         -- 28-07-2021 08:31:23; Level: INFO; Message: 127.0.0.1 - - [28/Jul/2021 08:31:23] "PUT /api/predictv2/1c4c3cccfd2b6369eccd7f1d69a4dd167e63350769ebe96c4ea6c7a9899acab0 HTTP/1.1" 200 -; Location: _internal._log
error:example_log:no partial match found

Any Ideas?

Thanks in advanced
Fabian

tstack · 2021-07-31T04:37:46Z

tstack
Jul 31, 2021
Maintainer

What version are you using? I think there was a bug in v0.9.0 that caused it to complain about the $schema property at the root. Can you remove that and try again? Otherwise, can you try the latest release, v0.10.0-beta1:

https://github.com/tstack/lnav/releases/tag/v0.10.0-beta1

Note that the timestamp needs to be regex, like the following, instead of the strftime() format:

"^(?<timestamp>\\d{2}-\\d{2}-\\d{4} \\d{2}:\\d{2}:\\d{2}); Level: (?<level>\\w+); Message: (?<body>.*); Location: (?<component>.*)$"

It looks like you'll need to add a timestamp-format property for your custom timestamp format (see https://docs.lnav.org/en/latest/formats.html#defining-a-new-format).

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Need help for custom Format #891

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

Need help for custom Format #891

Uh oh!

f4b0 Jul 28, 2021

Replies: 1 comment

Uh oh!

tstack Jul 31, 2021 Maintainer

f4b0
Jul 28, 2021

tstack
Jul 31, 2021
Maintainer