Friday, January 26, 2018

The SMS Experience


The SMS Experience

Post by CatalinaNJB


Many operators may have experienced SMS as a burden to the operations and an administrative task only, while other may have experienced tangible positive results as a function of implementing a Safety Management System. Everyone wants to operate safe, but SMS doesn’t always seem to get the job done. Days of working with SMS only add to the issue of operational tasks and incidents and accidents still happens. Endless days and nights of hard SMS work doesn’t get the job done or pays off in safety. All the SMS work seems to be never-ending circles of tasks and the wheels are spinning in one place. Different methods are applied but all it does is to create irrelevant safety tasks. More and more safety tasks are added, more rules and policies are implemented but all it does is generating unnecessary tasks. At the end of the day SMS haven’t made a bit difference in safety and it has not moved away from what safety was several years ago. Year after year the focus was on safety management safety is status quo, or even with a negative support trend.

Thinking outside the box generates a conflict with what is expected to be in the box.    
Air Operators or Airport Operators who implemented SMS have experienced frustration over SMS time and time over again. However, it is not possible to argue with safety and oppose regulations or policies with intent to make flying safer. Questioning safety doesn’t fit inside the box of safety expectations, safety policies or a mandatory safety regulation. 

Everybody says that safety is to think outside the box, but when it comes down to the nitty-gritty, outside the box processes are not accepted and findings are issued. Safety has become a tool to stay put inside the box without differentiate between regulatory requirements and operational safety processes. SMS has in its own way become its own enemy with miserable experiences for several operators and without a purpose. SMS is both being credited for 2017 to be one of the safest years in aviation history, while it is also being criticized for lack of effectiveness or lack of operational control when aviation accidents happen. SMS has ended up in a no-win situation and pushed out into no-man’s land.    

If to determine the effectiveness of SMS is to count the “good” data, or to count the times when things goes right rather than the “bad” data SMS has an incredible high success rate since there are very few landing that ends up in a disaster. This view also brings up the old saying that “Any landing you can walk away from is a good landing.” Analysis of aviation safety is, and has been since the beginning, to count undesired data. It is crucial to aviation safety to comprehend undesired data for continuous improvement analysis. Data can be grouped into two groups:

1) Common cause variations (normal operations); and
2) Special cause variations (abnormal operations)

By the way, there are no “good” or “bad” data. Data is emotionless. It is all just data and nothing else.
When counting these variations there is an opportunity for the SMS to be retrieved from this no-man’s land and analyze data for continuous safety improvement. SMS itself cannot fail. It’s fail-free since all it does is to make a recording of operational policies, processes, procedures and practices. SMS is a selfie of the operations.

When SMS is applied to continuous safety improvements, is when SMS has become more than an administrative tool of shuffling reports to different managers and departments. Continuous safety improvements might not be immediate noticeable, but over time the continuous improvement will show in a reduction in common cause variations. The reduction of common cause variations is where the return on investment is and a tool to improve effectiveness at a current operational efficiency level. When applying SMS as a practical tool for improvements, and a tool for ROI on safety, that is when an SMS program becomes alive and makes sense.

Birds are the effect of land use operations    
Let’s for a minute look at a scenario:  On approach to an airport there is a birdstrike causing damage to an airplane. An SMS report is filed, and the damages are repaired. The hazard associated with the SMS report is entered into a hazard registry, a response is submitted to the contributor. 

The report submitted to an appropriate manager, a risk assessment is conducted, the risk level is accepted or rejected, substitute and residual risks are assessed, a safety risk level is assigned in the hazard registry, a profile is generated of the associated hazard, the hazard is entered into objectives and goals records, criteria for investigation is determined, the investigation is conducted and concluded with an investigation summary, a root cause analysis is performed and includes contributing factors, a corrective action plan is assigned, a response to the contributor of the proposed CAP is submitted, including in the CAP are timelines, the CAP is assigned to a responsible person, a temporary SMS Ops Bulletin is issued for later to be implemented in the documentation, the CAP is implemented, monitored and assessed for performance goal and concludes with a response to the contributor that the CAP is closed. The air operator determined the root cause to be migratory bird season and the CAP to take change flight path when birds are in the area on approach or departure    

During the next 12 months the CAP is monitored, trending is applied, and a review is conducted of objectives and goals achievements and the hazard is re-issued a hazard priority to repeat the process as required. These are comprehensive tasks to address just for one type of hazard. At the end of the day there might not be any changes in safety improvement since year after year the birds are migrating across the same route and crossing the approach to the main runway.

In safety it's not the thought that counts.
When applying SMS processes as continuous improvement the air operator would include the airport in the CAP and review one or more CAPs generate by the airport operator, who is the expert of airport operations. 

These CAPs could ensure that there are no bird-feeding grounds or waters under final approach, the airport could conduct a bug-study for bird attractions and they could conducts study of cereal crops in the area that attracts birds and location of community landfills. When knowing these things, the airport has a opportunity to make changes to reduce bird activity in the area. By coordinating with the airport, the highest priority-level of hazards is mitigated or eliminated. If the bird-feeding grounds under final approach were to be removed, this would eventually lead to fewer birds in that area. The difference between the air operator only analysis, and the second, when the airport is involved, is that the airport is approaching it from a root cause prospective of a landuse issue, while the air operator is applying the root cause to airport operation for short term bird avoidance during operations.

Both root causes are valid and analyzing contributing factors with one goal in mind of continuous safety improvements. The continuous safety improvement factor is that each one of the root causes integrates with the other by analyzing a common variation of birds, but does this in two distinct and different ways.  



CatalinaNJB



Note: Some upcoming workshops in Canada from DTI Training Canada Ltd.
Winnipeg Mar 13-14,2018 Hosted by Keewatin Air
Vancouver Mar 27-28,2018 Hosted by Pacific Flying Club
Calgary April 10-11, 2018 Hosted by Integra Air

Basic Quality Assurance
Developing Acceptable Corrective Action Plans
Basic Auditing Principles 
For more information and sign up....

goto: dtiquality.com/workshops   or     dtitrainingcanada.ca/workshops  


Friday, January 5, 2018

Frequent Audits or Enhanced Monitoring

 Frequent Audits or Enhanced Monitoring 

Important Safety concept from CatalinaNJB


The latest news reports for airlines and passenger jet-aircraft are that 2017 was the safest year on record for commercial air travel with zero fatal accidents. When counting cargo planes and passenger turboprop aircraft, there were both fatalities to passengers and bystanders on the ground. This safety record may be contributed to several factors. Some might say that this is due to the implemented Safety Management System (SMS) in aviation, while other might say that this is due to enforcement of regulatory compliance. What to remember is that there are no self-made safety operators. Safety is a conglomerate of independent, but cooperative systems, processes, procedures and organizational policies. 


When an accident happens, it is an over-simplified solution to immediately place blame on the safety management system, in the same manner as it was over-simplified solutions to always blame accidents 


 A stable system could be effective for years to come 

on pilots. It could be that there was a system failure, and it could be that it was the pilot’s fault. However, without data to justify this root cause, a safety conclusion has been drawn based on bias opinions without facts. 
There are inherent risks in aviation. 

These risks are caused by common cause variations and special cause variations. Simplified, common cause variations could be identified as system failure, while special cause variations are variations due to unpredictable events. An effective Safety Management System is to operate with safety processes at a level above the bar of minimum acceptable level of safety and where anyone who demands process changes comprehends the Air Operator’s safety processes. Without comprehending the SMS there is a danger of over-controlling stable processes, or tampering with the processes. Over-controlling to change a result that is undesirable, or to make good SMS processes better could be due to demands by the regulatory authority, customer’s demand, or the operations itself. The result of over-controlling could generate a drift into higher probability of special cause variation to occur and generate a higher risk level which could cause a non-scheduled event. 

Customer service and regulatory compliance complement each other and do not contradict safety performance. Regulatory requirements form the structure necessary for safety in operations, while customer service drives the safety processes required for regulatory compliance and continuous customer satisfaction improvements. Regulations in themselves are not safety in operations requirements, but requirements for compliance in a static environment. This can be described as the issuance of an operator certificate, which is issued (and must be issued), prior to any flights take place. At the time and location when an aircraft moves under its own power is the beginning of operational safety, or continuous customer satisfaction. 

The task then becomes to maintain regulatory compliance and in addition, have processes in place to produce the best possible safety outcome. The SMS regulatory requirements are still applicable to static operations and become the accountability of the operators to apply SMS in their systems, policies, processes, procedures and expectations to monitor how their operational processes conform to regulatory requirements while in motion. When it is established that there is compliance with regulatory requirements, then an operator may move into continuous improvements of customer service, or safety, while still maintaining regulatory compliance. The Safety Management System is the NextGen of aviation safety with tools to monitor safety performance. 
Occasionally, both customers and regulatory authorities have vested interest in monitoring operations of a service supplier or certificate holder. 

Viewing from the fence is a process to see the overall picture. 
This can be accomplished by Enhanced Monitoring. When a customer takes on Enhanced Monitoring of their service provider, any findings are submitted to the operator as customer concerns. Should a customer demand changes in operational processes the outcome might be that a stable process could, by drift, produce a special cause variation and an unexpected event.

When the regulatory body takes on findings during Enhanced Monitoring they demand that an operator make changes. The regulator takes the driver’s seat while enhanced monitoring is applied, and an operator does not have the authority to make their own safety decisions. An operator must run all changes via the regulatory authority. This is how it must be, since the duty of the regulatory body is to provide services to the public and to ensure the interest of public safety is maintained. The regulator has an obligation to accept the risk on behalf of the public. The regulatory body has the authority to revoke certificates and must therefore be directly involved in operational management during the time of their Enhanced Monitoring. 

Enhanced Monitoring is a series of mini-audits and sampling of processes. The organization or person conducting enhanced monitoring must be onsite to collect real-time data and comprehend safety system processes as they are identified by the operator’s SMS. What Enhanced Monitoring is not: It is not a review of data produced by the operator themselves, since this data in itself is bias (this doesn’t imply that it is wrong or incorrect) and the regulator has not fulfilled their sampling of data or frequent mini-audits requirements to accept the risk on behalf of the public. Enhanced Monitoring only of an operator’s data is nothing else by a task to review intent. 

Enhanced Monitoring puts the pieces in a system where they belong 
A true enhanced monitoring is to collect real-time data, produce data into information, gain knowledge from this information and comprehend their SMS by analyzing information. In addition, enhanced monitoring takes on human factors, organizational factors, supervision factors and environmental factors. In short, enhanced monitoring is to sit on the fence to take notes and view the game of operational safety, which does include several common cause variations, and to view with the intent to spot any special cause variations that could cause unscheduled events. It is impossible for any deficiencies in the company's Operational Control System to escape scrutiny during an enhanced monitoring period. An effective enhanced monitoring takes at least three months to complete, depending on size and complexity of the operator. It crucial to safety that any operator, being an airline or airport, conducts ongoing and frequent internal mini-audits of their operations as their own internal enhanced monitoring. 


CatalinaNJB 

SIMPLE OR COMPREHENSIVE CAP

SIMPLE OR COMPREHENSIVE CAP By OffRoadPilots S ome time ago, a comprehensive series of Corrective Action Plans (CAPs) was developed for an a...