Sample

Sample 8D report: intermittent offline periods with cellular connectivity

This is how a root-cause report in 8D format is structured. Content and data are entirely fictitious.

Sample – synthetic, not a customer reference

Sample: this report is synthetic. Device, manufacturer, backend and all details are fictitious and describe a typical scenario, not a customer case.

FieldDetails
ReportSample (8D)
DeviceCharge point “Model A” from a fictitious manufacturer, cellular connectivity
FirmwareVersion “n” and predecessor “n−1”
Backendfictitious backend, OCPP 1.6J
Statusclosed

D1 – Participants

  • Manufacturer: support (second level) and firmware development
  • Operator: contact for backend data
  • Analysis and report: Sebastian Böttger

D2 – Problem description

QuestionFinding
What?Charge points repeatedly go offline in the backend for a few minutes; charging sessions cannot be started during this time.
Where?Only units with cellular connectivity; units on LAN are not affected.
Since when?Since the rollout of firmware version “n”.
How often?Several times a day, more frequently at night and during low usage.
How detected?Monitoring alerts in the backend, user complaints about sessions not starting.

D3 – Containment actions

  • Keepalive interval shortened on the affected units via configuration key.
  • Monitoring alert adjusted so that short interruptions are counted separately from real outages.

D4 – Root cause analysis

HypothesisCheckResult
Insufficient network coverage at the siteSignal quality from device logs against the times of the gapsrejected – gaps also occur with good signal quality
NAT timeout in the mobile network shorter than the keepalive intervalTime since the last message before each gap analysedconfirmed – gaps only after longer radio silence
Firmware “n” sends keepalives less often than “n−1”Default configuration of both versions comparedconfirmed – default value increased in “n”
Modem firmware loses the data connectionModem status messages around the gapsrejected – connection stable on the modem side

Root cause: Firmware version “n” increased the keepalive interval. With little traffic, the mobile network drops the connection when the NAT timeout expires. The charger only notices the drop when it next sends data and then re-establishes the connection.

D5 – Permanent corrective actions

  • Lower the default keepalive interval for cellular connectivity back below the NAT timeout.
  • Detect connection loss faster in the firmware and re-establish the connection immediately.

D6 – Implementation and verification

  • Corrected firmware rolled out to a test group first, then to the entire field.
  • Effectiveness verified via heartbeat intervals in the backend: the offline periods no longer occurred during the observation period.

D7 – Prevention

  • Default configuration documented per connectivity type.
  • Test case for long radio silence added to the release process for new firmware versions.
  • Error code catalogue and first-level decision tree extended with this failure pattern.

D8 – Closure

Report with evidence handed over to support and development, open questions resolved, case closed.

Send me your toughest open case.

Describe the failure pattern and the systems involved. You will receive an acknowledgement with follow-up questions.