Web Scraping or Web Crawler isolate Node

Question

Please, I’m trying to retrieve the following information:

"value bra": (<span class="value bra">3,666</span>)

<div class="ticker-financial-market" initiated="true">
   <div class="ticker-slide" style="width: 1446px;">
   	<section class="currencies">
	<div class="info">
		<a href="https://economia.uol.com.br/cotacoes/cambio/dolar-comercial-estados-unidos/">
		     <span class="name"> Dólar com.</span>
		     <div class="numbers">
			     <span class="data neg">-0,19</span>
			     <span class="value bra">3,666</span>
		     </div>
		</a>
	</div>
        </section>
   </div>
</div>

I’m trying with a very interesting emulator on the internet, namely: .Net Fiddle

But I’m not getting "ISOLATE" the NODE... ... no error return, the best I could do was this:

foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//section[@class='currencies']"))

That way returned values, but it’s NOT what I want:

foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//div/div/section/div"))

The complete code is:

using System;
using System.IO;    
using System.Xml;    
using System.Linq;    
using HtmlAgilityPack;

public class Program
{    
    public static void Main()
    {
        GetTftd();  
    }

    private static void GetTftd() {
        var url = @"https://economia.uol.com.br/cotacoes/cambio/dolar-comercial-estados-unidos/";
        var doc = new HtmlWeb().Load(url);

        foreach(HtmlNode link in doc.DocumentNode.SelectNodes("//div[@class=\"ticker-financial-market\"]/div[@class=\"ticker-slide\"]/section[@class=\"currencies\"]"))
        {
            Console.WriteLine(link.OuterHtml);
        }   
  }

I appreciate any help.

Answer 1

I couldn’t get on that site either, everything on <section class="currencies"></section> does not appear.. try another site:

var url = @"https://themoneyconverter.com/USD/BRL.aspx";
var doc = new HtmlWeb().Load(url);

var value = doc.DocumentNode.SelectSingleNode("//*[@id='cc-ratebox']");

Console.WriteLine(value.InnerText);