All of the builds are getting stuck in the queue, and the run time shows 0 seconds.
The build server is separate from the TFS server. It runs on Windows 7, and has been for the past year. There are no error in the Console on the build server or in TFS.
My build agents say ready, and have the green arrow.
Had gone thru this issue shown for TFS 2012. but under site binding, I only have one item in the list.
https://nkdagility.com/tfs-2012-issue-stuck-builds-in-team-foundation-build-with-no-build-number/
After digging through the logs, I found the error below. But, it makes no sense since nothing has changes since yesterday, and everybody has the same problem.
Log Name: Microsoft-Team Foundation Server-Build-Services/Operational
Source: Microsoft-Team Foundation Server-Build-Services
Date: 7/19/2016 6:47:58 PM
Event ID: 424
Task Category: WorkflowManager
Level: Error
Keywords: Process,WorkflowManager,Controller
User: xxxxxx\ocsbuild
Computer: xxxxxx.com
Description:
Bulkhead - Controller: Failed to finalize build vstfs:///Build/Build/21088 due to an exception.
Exception Type: Microsoft.TeamFoundation.Build.Client.AccessDeniedException
Exception Message: TF215106: Access denied. OCS-MAIN\kjackson needs Update build information permissions for build definition OasisQA--MWF in team project AtlasProd to perform the action. For more information, contact the Team Foundation Server administrator.
Stack Trace: at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.HandleReply(TfsClientOperation operation, TfsMessage message, Object[]& outputs)
at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.Invoke(TfsClientOperation operation, Object[] parameters, TimeSpan timeout, Object[]& outputs)
at Microsoft.TeamFoundation.Build.Client.BuildWebService4.UpdateBuildInformation(InformationChangeRequest[] changes)
at Microsoft.TeamFoundation.Build.Client.InformationNodeConverters.BulkUpdateInformationNodes(BuildDetail build, List`1 requests)
at Microsoft.TeamFoundation.Build.Client.BuildInformation.Save()
at Microsoft.TeamFoundation.Build.Hosting.BuildControllerWorkflowManager.FlushBuild(IBuildDetail build, BuildStatus finalStatus)
at Microsoft.TeamFoundation.Build.Hosting.BuildControllerWorkflowManager.OnInstanceCompleted(BuildWorkflowInstance instance, IDictionary`2 outputs, Exception terminationException)
Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"><System><Provider Name="Microsoft-Team Foundation Server-Build-Services" Guid="{05C4BC36-E3E1-4B96-9E0F-EB9337634CEC}" /><EventID>424</EventID><Version>0</Version><Level>2</Level><Task>6</Task><Opcode>28</Opcode><Keywords>0x4000340000000000</Keywords><TimeCreated SystemTime="2016-07-19T23:47:58.232849200Z" /><EventRecordID>10953</EventRecordID><Correlation ActivityID="{BE60AAEE-7459-4B64-A940-33D7C32453E7}" /><Execution ProcessID="2416" ThreadID="4568" /><Channel>Microsoft-Team Foundation Server-Build-Services/Operational</Channel><Computer>Bulkhead.oncenter.com</Computer><Security UserID="S-1-5-21-815403929-376661218-1404200075-18411" /></System><EventData><Data Name="MachineId">vstfs:///Build/ServiceHost/124</Data><Data Name="ProcessId">vstfs:///Build/Controller/15</Data><Data Name="ProcessName">xxxxxx- Controller</Data><Data Name="BuildUri">vstfs:///Build/Build/21088</Data><Data Name="FaultType">Microsoft.TeamFoundation.Build.Client.AccessDeniedException</Data><Data Name="FaultMessage">TF215106: Access denied. OCS-MAIN\kjackson needs Update build information permissions for build definition OasisQA--MWF in team project AtlasProd to perform the action. For more information, contact the Team Foundation Server administrator.</Data><Data Name="FaultStackTrace"> at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.HandleReply(TfsClientOperation operation, TfsMessage message, Object[]& outputs)
at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.Invoke(TfsClientOperation operation, Object[] parameters, TimeSpan timeout, Object[]& outputs)
at Microsoft.TeamFoundation.Build.Client.BuildWebService4.UpdateBuildInformation(InformationChangeRequest[] changes)
at Microsoft.TeamFoundation.Build.Client.InformationNodeConverters.BulkUpdateInformationNodes(BuildDetail build, List`1 requests)
at Microsoft.TeamFoundation.Build.Client.BuildInformation.Save()
at Microsoft.TeamFoundation.Build.Hosting.BuildControllerWorkflowManager.FlushBuild(IBuildDetail build, BuildStatus finalStatus)
at Microsoft.TeamFoundation.Build.Hosting.BuildControllerWorkflowManager.OnInstanceCompleted(BuildWorkflowInstance instance, IDictionary`2 outputs, Exception terminationException)</Data></EventData></Event>