Fetch value of a condition on lines and separate into a new dataset

Question

I have the following dataset

I’m trying to create a dataset based on the dataset above.

I am trying to search row by row values that are not Nan, export to a new dataset this value linked to column 'CO_OCDE'

Ex. At index 0 - The only value notnull() is the 2.5
So in the new dataset I want to get is:

But I found another "problem" in some lines there are duplicate values and need to remove them too to get the result above.

What I tried to

https://stackoverflow.com/questions/41337477/select-non-null-rows-from-a-specific-column-in-a-dataframe-and-take-a-sub-select

ex4_desc_y.loc[ex4_desc_y['NU_INTEGRALIZACAO_VESPERTINO', 'NU_INTEGRALIZACAO_NOTURNO', 'NU_INTEGRALIZACAO_INTEGRAL', 'NU_INTEGRALIZACAO_MATUTINO', 'NU_INTEGRALIZACAO_EAD'].notnull()]

Answer 1

Whereas the condition described below is true:

1. For each row, columns have either the same value or Nan

Therefore, it is enough to average them, because the method mean ignore Nan

Example

>>> import pandas as pd

>>> df = pd.DataFrame({"col1": [10, 20, 30], "col2": [None,20,30], "col3": [None,None,30]})

>>> df
   col1  col2  col3
0    10   NaN   NaN
1    20  20.0   NaN
2    30  30.0  30.0

>>> df['media'] = df.mean(axis=1)

>>> df
   col1  col2  col3  media
0    10   NaN   NaN   10.0
1    20  20.0   NaN   20.0
2    30  30.0  30.0   30.0

I hope it helps