DpddObjectCatalogRun2

On this page... (hide)

1. 2.1.1i
1. 1.1 stats
2. 1.2 tract/patches
3. 1.3 footprint
4. 1.4 density

1. 2.1.1i

probablement:

1.1 stats

start 78.945115 M
quality: good+clean=78 535221
extendedness:

+------------+--------+                                                         
|extendedness|   count|
+------------+--------+
|         0.0|18053475|
|        null|  688515|
|         1.0|59793231|
+------------+--------+

Nans:

comprend pas pourquoi psFlux_u quand psFlux_flag=False:

 num_nans(df.filter(df.extendedness==1).filter(df.psFlux_flag_u==False),"psFlux_u")

Out[53]: 143648

environ 13% ont un cModel
luminosites des galaxies

 dfqual=df.filter((df.good==1)&(df.clean==1))
 gal=dfqual.filter(df.extendedness==1)

mettre un filtre nan par bande:

 band="u"
 cols="ipix,psFlux_{0},psFluxErr_{0},mag_{0}_cModel,magerr_{0}_cModel,snr_{0}_cModel".format(band)
 u=gal.filter(df["psFlux_flag_{}".format(band)]==False).select(cols.split(",")).na.drop()
 u.describe(['mag_{}_cModel'.format(band)]).show()

+-------+------------------+------------------+------------------+------------------+------------------+------------------+                                                
|summary|      mag_u_cModel|      mag_g_cModel|      mag_r_cModel|      mag_i_cModel|      mag_z_cModel|      mag_y_cModel|
+-------+------------------+------------------+------------------+------------------+------------------+------------------+
|  count|          48072042|          57005129|          58318175|          57801176|          53346587|          50925252|
|   mean|25.400291096206107|25.230356824893377|24.713043869919918|24.264243311125462|23.923380551864046| 23.62417788692873|
| stddev|  1.65356787472827|1.5043608162604438|1.5009560864477443|1.5944570279549524|1.7092515903356118| 1.689081158989368|
|    min|13.415587712344362|13.357896773739803|12.602676589302162|12.216498205799605|11.943710325693061|11.739526866080423|
|    max|  49.9864381969632| 52.92680492636521| 52.67362120868114| 52.44813878758836|   50.624425396804| 56.20716098908366|
+-------+------------------+------------------+------------------+------------------+------------------+------------------+

Attetion : reste qq magerr_ Inf:

 
 u.filter(u['magerr_u_cModel'].contains(np.inf)).show()
+------------+------------------+-----------------+------------------+---------------+------------+
|extendedness|          psFlux_u|      psFluxErr_u|      mag_u_cModel|magerr_u_cModel|snr_u_cModel|
+------------+------------------+-----------------+------------------+---------------+------------+
|         1.0|134.32873622070406| 73.3064819053675|22.411638821620233|       Infinity|         0.0|
|         1.0|22.354402770836636|72.40601288011565|22.233810599597533|       Infinity|         0.0|
+------------+------------------+-----------------+------------------+---------------+------------+

1.2 tract/patches

 df.select("tract").distinct().count()

169

 df.groupBy(["tract","patch"]).count().groupBy("tract").count(). withColumnRenamed("count","#patches").sort("tract").show()

1.3 footprint

centre:

 df.describe(['ra','dec']).show()
+-------+-----------------+-------------------+
|summary|               ra|                dec|
+-------+-----------------+-------------------+
|  count|         78535221|           78535221|
|   mean|61.89355123721637|-36.006714393702175|
| stddev|6.238452834083089|  4.948643255064002|
|    min|49.48450655501503| -44.64103209990874|
|    max|74.20576195406575|-26.936966324793943|
+-------+-----------------+-------------------+

rot=[61.89355123721637,-36.006714393702175]

1.4 density

band="i"
cols="ipix,blendedness,psFlux_{0},psFluxErr_{0},mag_{0}_cModel,magerr_{0}_cModel,snr_{0}_cModel".format(band)
i=gal.filter(df["psFlux_flag_{}".format(band)]==False).select(cols.split(",")).na.drop()

cutblend=10**(-0.375)
iqual=i.filter( (i['blendedness']<cutblend) & (i['mag_i_cModel']<24) & (i['snr_i_cModel']>5))

skyMap=densitymap(iqual,rot=rot,xsize=350)