rcu: Move TINY_RCU quiescent state out of extended quiescent state
authorLi Zhong <zhong@linux.vnet.ibm.com>
Wed, 19 Sep 2012 15:52:32 +0000 (08:52 -0700)
committerPaul E. McKenney <paulmck@linux.vnet.ibm.com>
Sun, 23 Sep 2012 14:42:52 +0000 (07:42 -0700)
TINY_RCU's rcu_idle_enter_common() invokes rcu_sched_qs() in order
to inform the RCU core of the quiescent state implied by idle entry.
Of course, idle is also an extended quiescent state, so that the call
to rcu_sched_qs() speeds up RCU's invoking of any callbacks that might
be queued.  This speed-up is important when entering into dyntick-idle
mode -- if there are no further scheduling-clock interrupts, the callbacks
might never be invoked, which could result in a system hang.

However, processing callbacks does event tracing, which in turn
implies RCU read-side critical sections, which are illegal in extended
quiescent states.  This patch therefore moves the call to rcu_sched_qs()
so that it precedes the point at which we inform lockdep that RCU has
entered an extended quiescent state.

Signed-off-by: Li Zhong <zhong@linux.vnet.ibm.com>
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
kernel/rcutiny.c

index 2e073a24d25098326f44a032bdce9960341265d3..e4c6a598d6f749c9b5e322c372b953aea29c7b84 100644 (file)
@@ -75,9 +75,9 @@ static void rcu_idle_enter_common(long long newval)
                          current->pid, current->comm,
                          idle->pid, idle->comm); /* must be idle task! */
        }
+       rcu_sched_qs(0); /* implies rcu_bh_qsctr_inc(0) */
        barrier();
        rcu_dynticks_nesting = newval;
-       rcu_sched_qs(0); /* implies rcu_bh_qsctr_inc(0) */
 }
 
 /*