Age of Information for Multiple Source Multiple Server Networks. Having timely and fresh knowledge about the current state of information sources is critical in a variety of applications. In particular, a status update may arrive at the destination later than its generation time due to processing and communication delays. The freshness of the status update at the destination is captured by the notion of age of information. In this study, we analyze a multiple sensing network with multiple sources, multiple servers, and a monitor (destination). Each source corresponds to an independent piece of information and its age is measured individually. Given a particular source, the servers independently sense the source of information and send the status update to the monitor. We assume that updates arrive at the servers according to Poisson random processes. Each server sends its updates to the monitor through a direct link, which is modeled as a queue. The service time to transmit an update is considered to be an exponential random variable. We examine both homogeneous and heterogeneous service and arrival rates for the single source case, and only homogeneous arrival and service rates for the multiple source case. We derive a closed form expression for the average age of information under a last come first serve (LCFS) queue for a single source and arbitrary number of homogeneous servers. Using a recursive method, we derive the explicit average age of information for any number of sources and homogeneous servers. We also investigate heterogeneous servers and a single source, and present algorithms for finding the average age of information.


Sobolev Inequalities and Convergence For Riemannian Metrics and Distance Functions. If one thinks of a Riemannian metric, g 1 , analogously as the gradient of the corresponding distance function, d 1 , with respect to a background Riemannian metric, g 0 , then a natural question arises as to whether a corresponding theory of Sobolev inequalities exists between the Riemannian metric and its distance function. In this paper we study the sub critical case p frac m 2 and show a Sobolev inequality exists where an L frac p 2 bound on a Riemannian metric implies an L q bound on its corresponding distance function. We then use this result to state a convergence theorem and show how this theorem can be useful to prove geometric stability results by proving a version of Gromov's conjecture for tori with almost non negative scalar curvature in the conformal case. Examples are given to show that the hypotheses of the main theorems are necessary.


Improving the Silicon Interactions of GFN xTB. A general purpose Density Functional Tight Binding method, the GFN xTB model is gaining increased popularity in accurate simulations that are out of scope for conventional ab initio formalisms. We show that in its original GFN1 xTB parametrization, organosilicon compounds are described poorly. This issue is addressed by re fitting the model's silicon parameters to a data set of ten thousand reference compounds, geometry optimized with the revPBE functional. The resulting GFN1 xTB Si parametrization shows improved accuracy in the prediction of system energies, nuclear forces and geometries and should be considered for all applications of the GFN xTB Hamiltonian to systems that contain silicon.


Home and destination attachment study of cultural integration on Twitter. The cultural integration of immigrants conditions their overall socio economic integration as well as natives' attitudes towards globalisation in general and immigration in particular. At the same time, excessive integration or acculturation can be detrimental in that it implies forfeiting one's ties to the home country and eventually translates into a loss of diversity (from the viewpoint of host countries) and of global connections (from the viewpoint of both host and home countries). Cultural integration can be described using two dimensions the preservation of links to the home country and culture, which we call home attachment, and the creation of new links together with the adoption of cultural traits from the new residence country, which we call destination attachment. In this paper we introduce a means to quantify these two aspects based on Twitter data. We build home and destination attachment indexes and analyse their possible determinants (e.g., language proximity, distance between countries), also in relation to Hofstede's cultural dimension scores. The results stress the importance of host language proficiency to explain destination attachment, but also the link between language and home attachment. In particular, the common language between home and destination countries corresponds to increased home attachment, as does low proficiency in the host language. Common geographical borders also seem to increase both home and destination attachment. Regarding cultural dimensions, larger differences among home and destination country in terms of Individualism, Masculinity and Uncertainty appear to correspond to larger destination attachment and lower home attachment.


Multi color balancing for correctly adjusting the intensity of target colors. In this paper, we propose a novel multi color balance method for reducing color distortions caused by lighting effects. The proposed method allows us to adjust three target colors chosen by a user in an input image so that each target color is the same as the corresponding destination (benchmark) one. In contrast, white balancing is a typical technique for reducing the color distortions, however, they cannot remove lighting effects on colors other than white. In an experiment, the proposed method is demonstrated to be able to remove lighting effects on selected three colors, and is compared with existing white balance adjustments.


Transparent Conductive Oxides based Architectures for the Electrical Modulation of the Optical Response A Spectroscopic Ellipsometry Study. Transparent Conductive Oxides (TCOs) are a class of materials that combine high optical transparency with high electrical conductivity. This property makes them uniquely appealing as transparent conductive electrodes in solar cells and interesting for optoelectronics and infrared plasmonics applications. One of the new challenges that researchers and engineers are facing is merging optical and electrical control in a single device for developing next generation photovoltaic, opto electronic devices and energyefficient solid state lighting. In this work, we investigated the possible variations in the dielectric properties of aluminum doped ZnO (AZO) upon gating, by means of Spectroscopic Ellipsometry (SE). We investigated the electrical bias dependent optical response of thin AZO films fabricated by magnetron sputtering, within a parallel plane capacitor configuration. We address the possibility to control their optical and electric performances by applying bias, monitoring the effect of charge injection depletion in the AZO layer by means of in operando SE vs applied gate voltage.


Diversity aware Web APIs Recommendation with Compatibility Guarantee. With the ever increasing prevalence of web APIs (Application Programming Interfaces) in enabling smart software developments, finding and composing a list of existing web APIs that can corporately fulfil the software developers' functional needs have become a promising way to develop a successful mobile app, economically and conveniently. However, the big volume and diversity of candidate web APIs put additional burden on the app developers' web APIs selection decision makings, since it is often a challenging task to simultaneously guarantee the diversity and compatibility of the finally selected a set of web APIs. Considering this challenge, a Diversity aware and Compatibility driven web APIs Recommendation approach, namely DivCAR, is put forward in this paper. First, to achieve diversity, DivCAR employs random walk sampling technique on a pre built correlation graph to generate diverse correlation subgraphs. Afterwards, with the diverse correlation subgraphs, we model the compatible web APIs recommendation problem to be a minimum group Steiner tree search problem. Through solving the minimum group Steiner tree search problem, manifold sets of compatible and diverse web APIs ranked are returned to the app developers. At last, we design and enact a set of experiments on a real world dataset crawled from www.programmableWeb.com. Experimental results validate the effectiveness and efficiency of our proposed DivCAR approach in balancing the web APIs recommendation diversity and compatibility.


Trace regularity for biharmonic evolution equations with Caputo derivatives. Our goal is to establish a hidden regularity result for solutions of time fractional Petrovsky system where the Caputo fractional derivative is of order alpha in(1,2) . We achieve such result for a suitable class of weak solutions.


The hydrodynamic characteristics of Autonomous Underwater Vehicles in rotating flow fields. In this article, the hydrodynamic characteristics of Autonomous Underwater Vehicles (AUVs) are investigated and analyzed under the influence of rotating flow fields, that were generated in a recirculating water tank via a rotating propeller. Initially, experiments were carried out for the measurement of flow field variables and Quantities of Interest across the AUV in the presence of the rotating propeller while varying the rotational speed and the extent of rotational flow strength. The flow field across the AUV was measured using an Acoustic Doppler Velocimeter (ADV). These measured turbulent flow statistics were used to validate the Reynolds Stress Model (RSM) based numerical predictions in a commercial CFD solver. After preliminary validation of the turbulent flow statistics with the numerical predictions, a series of numerical simulations were performed to investigate the effect of the rotational flow field of the propeller on the drag, skin friction and pressure coefficients of the AUV. The operating speed and location of the propeller were also varied to check their affects on the hydrodynamic performance of AUV. The results provided in this article will be useful for the design optimization of AUVs cruising in shallow water where the flow is highly rotational because of wave current interactions. Additionally the results and analysis are relevant to study the design and operation of AUVs that have to operate in a group of unmanned underwater vehicles or near submarines and ships where the flow field is highly complex and such rotational effects are present.


Legio Fault Resiliency for Embarrassingly Parallel MPI Applications. Due to the increasing size of HPC machines, the fault presence is becoming an eventuality that applications must face. Natively, MPI provides no support for the execution past the detection of a fault, and this is becoming more and more constraining. With the introduction of ULFM (User Level Fault Mitigation library), it has been provided with a possible way to overtake a fault during the application execution at the cost of code modifications. ULFM is intrusive in the application and requires also a deep understanding of its recovery procedures. In this paper we propose Legio, a framework that lowers the complexity of introducing resiliency in an embarrassingly parallel MPI application. By hiding ULFM behind the MPI calls, the library is capable to expose resiliency features to the application in a transparent manner thus removing any integration effort. Upon fault, the failed nodes are discarded and the execution continues only with the non failed ones. A hierarchical implementation of the solution has been also proposed to reduce the overhead of the repair process when scaling towards a large number of nodes. We evaluated our solutions on the Marconi100 cluster at CINECA, showing that the overhead introduced by the library is negligible and it does not limit the scalability properties of MPI. Moreover, we also integrated the solution in real world applications to further prove its robustness by injecting faults.


VOLO Vision Outlooker for Visual Recognition. Visual recognition has been dominated by convolutional neural networks (CNNs) for years. Though recently the prevailing vision transformers (ViTs) have shown great potential of self attention based models in ImageNet classification, their performance is still inferior to that of the latest SOTA CNNs if no extra data are provided. In this work, we try to close the performance gap and demonstrate that attention based models are indeed able to outperform CNNs. We find a major factor limiting the performance of ViTs for ImageNet classification is their low efficacy in encoding fine level features into the token representations. To resolve this, we introduce a novel outlook attention and present a simple and general architecture, termed Vision Outlooker (VOLO). Unlike self attention that focuses on global dependency modeling at a coarse level, the outlook attention efficiently encodes finer level features and contexts into tokens, which is shown to be critically beneficial to recognition performance but largely ignored by the self attention. Experiments show that our VOLO achieves 87.1 top 1 accuracy on ImageNet 1K classification, which is the first model exceeding 87 accuracy on this competitive benchmark, without using any extra training data In addition, the pre trained VOLO transfers well to downstream tasks, such as semantic segmentation. We achieve 84.3 mIoU score on the cityscapes validation set and 54.3 on the ADE20K validation set. Code is available at url https github.com sail sg volo .


Selective decay for the rotating shallow water equations with a structure preserving discretization. Numerical models of weather and climate critically depend on long term stability of integrators for systems of hyperbolic conservation laws. While such stability is often obtained from (physical or numerical) dissipation terms, physical fidelity of such simulations also depends on properly preserving conserved quantities, such as energy, of the system. To address this apparent paradox, we develop a variational integrator for the shallow water equations that conserves energy, but dissipates potential enstrophy. Our approach follows the continuous selective decay framework F. Gay Balmaz and D. Holm. Selective decay by Casimir dissipation in inviscid fluids. Nonlinearity, 26(2) 495, 2013 , which enables dissipating an otherwise conserved quantity while conserving the total energy. We use this in combination with the variational discretization method D. Pavlov, P. Mullen, Y. Tong, E. Kanso, J. Marsden and M. Desbrun. Structure preserving discretization of incompressible fluids. Physica D Nonlinear Phenomena, 240(6) 443 458, 2011 to obtain a discrete selective decay framework. This is applied to the shallow water equations, both in the plane and on the sphere, to dissipate the potential enstrophy. The resulting scheme significantly improves the quality of the approximate solutions, enabling long term integrations to be carried out.


physics.flu-dyn cs.LG cs.NA math.NA physics.comp-ph

An artificial neural network approach to bifurcating phenomena in computational fluid dynamics. This work deals with the investigation of bifurcating fluid phenomena using a reduced order modelling setting aided by artificial neural networks. We discuss the POD NN approach dealing with non smooth solutions set of nonlinear parametrized PDEs. Thus, we study the Navier Stokes equations describing (i) the Coanda effect in a channel, and (ii) the lid driven triangular cavity flow, in a physical geometrical multi parametrized setting, considering the effects of the domain's configuration on the position of the bifurcation points. Finally, we propose a reduced manifold based bifurcation diagram for a non intrusive recovery of the critical points evolution. Exploiting such detection tool, we are able to efficiently obtain information about the pattern flow behaviour, from symmetry breaking profiles to attaching spreading vortices, even at high Reynolds numbers.


New views of old proteins clarifying the enigmatic proteome. All human diseases involve proteins, yet our current tools to characterize and quantify them are limited. To better elucidate proteins across space, time, and molecular composition, we provide provocative projections for technologies to meet the challenges that protein biology presents. With a broad perspective, we discuss grand opportunities to transition the science of proteomics into a more propulsive enterprise. Extrapolating recent trends, we offer potential futures for a next generation of disruptive approaches to define, quantify and visualize the multiple dimensions of the proteome, thereby transforming our understanding and interactions with human disease in the coming decade.


Convergence rate for the incompressible limit of nonlinear diffusion advection equations. The incompressible limit of nonlinear diffusion equations of porous medium type has attracted a lot of attention in recent years, due to its ability to link the weak formulation of cell population models to free boundary problems of Hele Shaw type. Although vast literature is available on this singular limit, little is known on the convergence rate of the solutions. In this work, we compute the convergence rate in a negative Sobolev norm and, upon interpolating with BV uniform bounds, we deduce a convergence rate in appropriate Lebesgue spaces.


Bifurcation loci of families of finite type meromorphic maps. We study bifurcation phenomena in natural families of rational, (transcendental) entire or meromorphic functions of finite type f lambda varphi lambda circ f lambda 0 circ psi 1 lambda lambda in M , where M is a complex connected manifold, lambda 0 in M , f lambda 0 is a meromorphic map and varphi lambda and psi lambda are families of quasiconformal homeomorphisms depending holomorphically on lambda and with psi lambda( infty) infty . There are fundamental differences compared to the rational or entire setting due to the presence of poles and therefore of parameters for which singular values are eventually mapped to infinity (singular parameters). Under mild geometric conditions we show that singular (asymptotic) parameters are the endpoint of a curve of parameters for which an attracting cycle progressively exits de domain, while its multiplier tends to zero. This proves the main conjecture by Fagella and Keen (asymptotic parameters are virtual centers) in a very general setting. Other results in the paper show the connections between cycles exiting the domain, singular parameters, activity of singular orbits and J unstability, converging to a theorem in the spirit of the celebrated result by Ma n 'e Sad Sullivan and Lyubich.


Preventing Small mathbf (s,t) Cuts by Protecting Edges. We introduce and study Weighted Min (s,t) Cut Prevention, where we are given a graph G (V,E) with vertices s and t and an edge cost function and the aim is to choose an edge set D of total cost at most d such that G has no (s,t) edge cut of capacity at most a that is disjoint from D . We show that Weighted Min (s,t) Cut Prevention is NP hard even on subcubcic graphs when all edges have capacity and cost one and provide a comprehensive study of the parameterized complexity of the problem. We show, for example W 1 hardness with respect to d and an FPT algorithm for a .


On homomorphisms into Weyl modules corresponding to partitions with two parts. Let K be an infinite field of characteristic p 0 and let lambda, mu be partitions, where mu has two parts. We find sufficient arithmetic conditions on p, lambda, mu for the existence of a nonzero homomorphism Delta( lambda) to Delta ( mu) of Weyl modules for the general linear group GL n(K) . Also for each p we find sufficient conditions so that the corresponding homomorphism spaces have dimension at least 2.


A New Parallel Algorithm for Sinkhorn Word Movers Distance and Its Performance on PIUMA and Xeon CPU. The Word Movers Distance (WMD) measures the semantic dissimilarity between two text documents by computing the cost of optimally moving all words of a source query document to the most similar words of a target document. Computing WMD between two documents is costly because it requires solving an O(V 3log(V)) optimization problem where V is the number of unique words in the document. Fortunately, WMD can be framed as an Earth Mover's Distance (EMD) for which the algorithmic complexity can be reduced to O(V 2) by adding an entropy penalty to the optimization problem and solving it using the Sinkhorn Knopp algorithm. Additionally, the computation can be made highly parallel by adopting a batching approach, i.e., computing the WMD of a single query document against multiple target documents at once. Sinkhorn WMD is a key kernel used in many ML NLP applications. and usually gets implemented in Python. However, a straightforward Python implementation may leave significant performance on the table even though it may internally call optimized C BLAS routines. We present a new sparse P arallel A lgorithm for S inkhorn Knopp W ord movers D istance to compute the semantic distance of one document to many other documents by adopting the O(V 2) EMD algorithm. We algorithmically transform O(V 2) dense compute heavy EMD version into an equivalent sparse one using new fused SDDMM SpMM (sparse selection of dense dense matrix , sparse dense matrix multiplication) kernels. We implemented and optimized this algorithm for two very different architectures the new Intel Programmable Integrated Unified Memory Architecture (PIUMA) and Intel Xeon CPUs. We show that we were able to reach close to peak performance on both platforms.


An underwater binocular stereo matching algorithm based on the best search domain. Binocular stereo vision is an important branch of machine vision, which imitates the human eye and matches the left and right images captured by the camera based on epipolar constraints. The matched disparity map can be calculated according to the camera imaging model to obtain a depth map, and then the depth map is converted to a point cloud image to obtain spatial point coordinates, thereby achieving the purpose of ranging. However, due to the influence of illumination under water, the captured images no longer meet the epipolar constraints, and the changes in imaging models make traditional calibration methods no longer applicable. Therefore, this paper proposes a new underwater real time calibration method and a matching method based on the best search domain to improve the accuracy of underwater distance measurement using binoculars.


Formal Security Analysis on dBFT Protocol of NEO. NEO is one of the top public chains worldwide. We focus on its backbone consensus protocol, called delegated Byzantine Fault Tolerance (dBFT). The dBFT protocol has been adopted by a variety of blockchain systems such as ONT. dBFT claims to guarantee the security when no more than f lfloor frac n 3 rfloor nodes are Byzantine, where n is the total number of consensus participants. However, we identify attacks to break the claimed security. In this paper, we show our results by providing a security analysis on its dBFT protocol. First, we evaluate NEO's source code and formally present the procedures of dBFT via the state machine replication (SMR) model. Next, we provide a theoretical analysis with two example attacks. These attacks break the security of dBFT with no more than f nodes. Then, we provide recommendations on how to fix the system against the identified attacks. The suggested fixes have been accepted by the NEO official team. Finally, we further discuss the reasons causing such issues, the relationship with current permissioned blockchain systems, and the scope of potential influence.


On the analytical aspects of inertial particle motion. In their seminal 1983 paper, M. Maxey and J. Riley introduced an equation for the motion of a sphere through a fluid. Since this equation features the Basset history integral, the popularity of this equation has broadened the use of a certain form of fractional differential equation to study inertial particle motion. In this paper, we give a comprehensive theoretical analysis of the Maxey Riley equation. In particular, we build on previous local in time existence and uniqueness results to prove that solutions of the Maxey Riley equation are global in time. In doing so, we also prove that the notion of a maximal solution extends to this equation. We furthermore prove conditions under which solutions are differentiable at the initial time. By considering the derivative of the solution with respect to the initial conditions, we perform a sensitivity analysis and demonstrate that two inertial trajectories can not meet, as well as provide a control on the growth of the distance between a pair of inertial particles. The properties we prove here for the Maxey Riley equations are also possessed, mutatis mutandis, by a broader class of fractional differential equations of a similar form.


Charmenability of higher rank arithmetic groups. We complete the study of characters on higher rank semisimple lattices initiated in BH19,BBHP20 , the missing case being the case of lattices in higher rank simple algebraic groups in arbitrary characteristics. More precisely, we investigate dynamical properties of the conjugation action of such lattices on their space of positive definite functions. Our main results deal with the existence and the classification of characters from which we derive applications to topological dynamics, ergodic theory, unitary representations and operator algebras. Our key theorem is an extension of the noncommutative Nevo Zimmer structure theorem obtained in BH19 to the case of simple algebraic groups defined over arbitrary local fields. We also deduce a noncommutative analogue of Margulis' factor theorem for von Neumann subalgebras of the noncommutative Poisson boundary of higher rank arithmetic groups.


A SDFEM for system of two singularly perturbed problems of convection diffusion type with discontinuous source term. We consider a system of two singularly perturbed Boundary Value Problems (BVPs) of convection diffusion type with discontinuous source terms and a small positive parameter multiplying the highest derivatives. Then their solutions exhibit boundary layers as well as weak interior layers. A numerical method based on finite element method (Shishkin and Bakhvalov Shishkin meshes) is presented. We derive an error estimate of order O(N 1 ln 3 2 N ) in the energy norm with respect to the perturbation parameter. Numerical experiments are also presented to support our theoretical results.


Resonating Minds Emergent Collaboration Through Hierarchical Active Inference. Working together on complex collaborative tasks requires agents to coordinate their actions. Doing this explicitly or completely prior to the actual interaction is not always possible nor sufficient. Agents also need to continuously understand the current actions of others and quickly adapt their own behavior appropriately. Here we investigate how efficient, automatic coordination processes at the level of mental states (intentions, goals), which we call belief resonance, can lead to collaborative situated problem solving. We present a model of hierarchical active inference for collaborative agents (HAICA). It combines efficient Bayesian Theory of Mind processes with a perception action system based on predictive processing and active inference. Belief resonance is realized by letting the inferred mental states of one agent influence another agent's predictive beliefs about its own goals and intentions. This way, the inferred mental states influence the agent's own task behavior without explicit collaborative reasoning. We implement and evaluate this model in the Overcooked domain, in which two agents with varying degrees of belief resonance team up to fulfill meal orders. Our results demonstrate that agents based on HAICA achieve a team performance comparable to recent state of the art approaches, while incurring much lower computational costs. We also show that belief resonance is especially beneficial in settings were the agents have asymmetric knowledge about the environment. The results indicate that belief resonance and active inference allow for quick and efficient agent coordination, and thus can serve as a building block for collaborative cognitive agents.


Multi Domain Adaptation in Neural Machine Translation Through Multidimensional Tagging. While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is typically addressed by training domain specific models, using fine tuning methods and some variation of back translation on top of in domain monolingual corpora. However, industrial practitioners can rarely afford to focus on a single domain. A far more typical scenario includes a set of closely related, yet succinctly different sub domains. At Booking.com, we need to translate property descriptions, user reviews, as well as messages, (for example those sent between a customer and an agent or property manager). An editor might need to translate articles across a set of different topics. An e commerce platform would typically need to translate both the description of each item and the user generated content related to them. To this end, we propose MDT a novel method to simultaneously fine tune on several sub domains by passing multidimensional sentence level information to the model during training and inference. We show that MDT achieves results competitive to N specialist models each fine tuned on a single constituent domain, while effectively serving all N sub domains, therefore cutting development and maintenance costs by the same factor. Besides BLEU (industry standard automatic evaluation metric known to only weakly correlate with human judgement) we also report rigorous human evaluation results for all models and sub domains as well as specific examples that better contextualise the performance of each model in terms of adequacy and fluency. To facilitate further research, we plan to make the code available upon acceptance.


Imperfect also Deserves Reward Multi Level and Sequential Reward Modeling for Better Dialog Management. For task oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies have been proposed to give proper rewards when training RL, but their rewards lack interpretability and cannot accurately estimate the distribution of state action pairs in real dialogs. In this paper, we propose a multi level reward modeling approach that factorizes a reward into a three level hierarchy domain, act, and slot. Based on inverse adversarial reinforcement learning, our designed reward model can provide more accurate and explainable reward signals for state action pairs.Extensive evaluations show that our approach can be applied to a wide range of reinforcement learning based dialog systems and significantly improves both the performance and the speed of convergence.


From Kepler to Newton Explainable AI for Science Discovery. The Observation Hypothesis Prediction Experimentation loop paradigm for scientific research has been practiced by researchers for years towards scientific discoveries. However, with data explosion in both mega scale and milli scale scientific research, it has been sometimes very difficult to manually analyze the data and propose new hypothesis to drive the cycle for scientific discovery. In this paper, we discuss the role of Explainable AI in scientific discovery process by demonstrating an Explainable AI based paradigm for science discovery. The key is to use Explainable AI to help derive data or model interpretations as well as scientific discoveries or insights. We show how computational and data intensive methodology together with experimental and theoretical methodology can be seamlessly integrated for scientific research. To demonstrate the AI based science discovery process, and to pay our respect to some of the greatest minds in human history, we show how Kepler's laws of planetary motion and the Newton's law of universal gravitation can be rediscovered by (Explainable) AI based on Tycho Brahe's astronomical observation data, whose works were leading the scientific revolution in the 16 17th century. This work also highlights the important role of Explainable AI (as compared to Blackbox AI) in science discovery to help humans prevent or better prepare for the possible technological singularity that may happen in the future.


Deep Learning based Spacecraft Relative Navigation Methods A Survey. Autonomous spacecraft relative navigation technology has been planned for and applied to many famous space missions. The development of on board electronics systems has enabled the use of vision based and LiDAR based methods to achieve better performances. Meanwhile, deep learning has reached great success in different areas, especially in computer vision, which has also attracted the attention of space researchers. However, spacecraft navigation differs from ground tasks due to high reliability requirements but lack of large datasets. This survey aims to systematically investigate the current deep learning based autonomous spacecraft relative navigation methods, focusing on concrete orbital applications such as spacecraft rendezvous and landing on small bodies or the Moon. The fundamental characteristics, primary motivations, and contributions of deep learning based relative navigation algorithms are first summarised from three perspectives of spacecraft rendezvous, asteroid exploration, and terrain navigation. Furthermore, popular visual tracking benchmarks and their respective properties are compared and summarised. Finally, potential applications are discussed, along with expected impediments.


Capturing social media expressions during the COVID 19 pandemic in Argentina and forecasting mental health and emotions. Purpose. We present an approach for forecasting mental health conditions and emotions of a given population during the COVID 19 pandemic in Argentina based on language expressions used in social media. This approach permits anticipating high prevalence periods in short to medium term time horizons. Design. Mental health conditions and emotions are captured via markers, which link social media contents with lexicons. First, we build descriptive timelines for decision makers to monitor the evolution of markers, and their correlation with crisis events. Second, we model the timelines as time series, and support their forecasting, which in turn serve to identify high prevalence points for the estimated markers. Findings. Results showed that different time series forecasting strategies offer different capabilities. In the best scenario, the emergence of high prevalence periods of emotions and mental health disorders can be satisfactorily predicted with a neural network strategy, even when limited data is available in early stages of a crisis (e.g., 7 days). Originality. Although there have been efforts in the literature to predict mental states of individuals, the analysis of mental health at the collective level has received scarce attention. We take a step forward by proposing a forecasting approach for analyzing the mental health of a given population (or group of individuals) at a larger scale. Practical implications. We believe that this work contributes to a better understanding of how psychological processes related to crisis manifest in social media, being a valuable asset for the design, implementation and monitoring of health prevention and communication policies.


A scalable solver for a stochastic, hybrid cellular automaton model of personalized breast cancer therapy. Mathematical modeling and simulation is a promising approach to personalized cancer medicine. Yet, the complexity, heterogeneity and multi scale nature of cancer pose significant computational challenges. Coupling discrete cell based models with continuous models using hybrid cellular automata is a powerful approach for mimicking biological complexity and describing the dynamical exchange of information across different scales. However, when clinically relevant cancer portions are taken into account, such models become computationally very expensive. While efficient parallelization techniques for continuous models exist, their coupling with discrete models, particularly cellular automata, necessitates more elaborate solutions. Building upon FEniCS, a popular and powerful scientific computing platform for solving partial differential equations, we developed parallel algorithms to link stochastic cellular automata with differential equations ( https bitbucket.org HTasken cansim ). The algorithms minimize the communication between processes that share cellular automata neighborhood values while also allowing for reproducibility during stochastic updates. We demonstrated the potential of our solution on a complex hybrid cellular automaton model of breast cancer treated with combination chemotherapy. On a single core processor, we obtained nearly linear scaling with an increasing problem size, whereas weak parallel scaling showed moderate growth in solving time relative to increase in problem size. Finally we applied the algorithm to a problem that is 500 times larger than previous work, allowing us to run personalized therapy simulations based on heterogeneous cell density and tumor perfusion conditions estimated from magnetic resonance imaging data on an unprecedented scale.


Neural Search Learning Query and Product Representations in Fashion E commerce. Typical e commerce platforms contain millions of products in the catalog. Users visit these platforms and enter search queries to retrieve their desired products. Therefore, showing the relevant products at the top is essential for the success of e commerce platforms. We approach this problem by learning low dimension representations for queries and product descriptions by leveraging user click stream data as our main source of signal for product relevance. Starting from GRU based architectures as our baseline model, we move towards a more advanced transformer based architecture. This helps the model to learn contextual representations of queries and products to serve better search results and understand the user intent in an efficient manner. We perform experiments related to pre training of the Transformer based RoBERTa model using a fashion corpus and fine tuning it over the triplet loss. Our experiments on the product ranking task show that the RoBERTa model is able to give an improvement of 7.8 in Mean Reciprocal Rank(MRR), 15.8 in Mean Average Precision(MAP) and 8.8 in Normalized Discounted Cumulative Gain(NDCG), thus outperforming our GRU based baselines. For the product retrieval task, RoBERTa model is able to outperform other two models with an improvement of 164.7 in Precision 50 and 145.3 in Recall 50. In order to highlight the importance of pre training RoBERTa for fashion domain, we qualitatively compare already pre trained RoBERTa on standard datasets with our custom pre trained RoBERTa over a fashion corpus for the query token prediction task. Finally, we also show a qualitative comparison between GRU and RoBERTa results for product retrieval task for some test queries.


Quasi Time Fuel Optimal Control Strategy for dynamic target tracking. This brief proposes a quasi time fuel optimal control strategy to solve the dynamic tracking problem of unmanned systems when fuel and control input are limited. This kind of motion planning and control strategy could bring the biggest advantage into full play in the field of switching tracking for multiple targets, such as the multi target strike of weapons and the rapid multi target grabbing of robots on industrial assembly lines. Compared with the time fuel optimal control that has been studied before, the proposed controller retains the advantages of optimal control when switching between multiple dynamic targets, and improves the high frequency oscillation problem of the system under the discontinuous control strategy. Moreover, the asymmetry of friction load, which can affect the dynamic performance of the system, is also considered in this brief. Therefore, the novel control law, which is addressed by this brief, can make the corresponding system achieve the desired transient performance and satisfactory steady state performance when switching between multiple dynamic targets. The experiment results based on the visual tracking turntable are presented to verify the superiority of the proposed method.


GridDehazeNet An Enhanced Multi Scale Network with Intra Task Knowledge Transfer for Single Image Dehazing. We propose an enhanced multi scale network, dubbed GridDehazeNet , for single image dehazing. The proposed dehazing method does not rely on the Atmosphere Scattering Model (ASM), and an explanation as to why it is not necessarily performing the dimension reduction offered by this model is provided. GridDehazeNet consists of three modules pre processing, backbone, and post processing. The trainable pre processing module can generate learned inputs with better diversity and more pertinent features as compared to those derived inputs produced by hand selected pre processing methods. The backbone module implements multi scale estimation with two major enhancements 1) a novel grid structure that effectively alleviates the bottleneck issue via dense connections across different scales 2) a spatial channel attention block that can facilitate adaptive fusion by consolidating dehazing relevant features. The post processing module helps to reduce the artifacts in the final output. Due to domain shift, the model trained on synthetic data may not generalize well on real data. To address this issue, we shape the distribution of synthetic data to match that of real data, and use the resulting translated data to finetune our network. We also propose a novel intra task knowledge transfer mechanism that can memorize and take advantage of synthetic domain knowledge to assist the learning process on the translated data. Experimental results demonstrate that the proposed method outperforms the state of the art on several synthetic dehazing datasets, and achieves the superior performance on real world hazy images after finetuning.


The Jacobi operator and its Donoghue m functions. In this paper we construct Donoghue m functions for the Jacobi differential operator in L 2 big(( 1,1) (1 x) alpha (1 x) beta dx big) , associated to the differential expression begin align begin split tau alpha, beta (1 x) alpha (1 x) beta (d dx) big((1 x) alpha 1 (1 x) beta 1 big) (d dx), x in ( 1,1), alpha, beta in mathbb R , end split end align whenever at least one endpoint, x pm 1 , is in the limit circle case. In doing so, we provide a full treatment of the Jacobi operator's m functions corresponding to coupled boundary conditions whenever both endpoints are in the limit circle case, a topic not covered in the literature.


Hausdorff Dimension and Lebesgue Measure of Codiagonal of Embedded Vector Bundles over Submanifolds in Euclidean Space. In this paper we study measure theoretical size of the image of naturally embedded vector bundles in mathbb R n times mathbb R n under the codiagonal morphism, i.e. Delta in the category of finite dimensional mathbb R vector spaces. Under very weak smoothness condition we show that codiagonal of normal bundles always contain an open subset of the ambient space, and we give corresponding criterions for the tangent bundles. For any differentiable hypersurface we show that the codiagonal of its tangent bundle has non empty interior, unless the hypersurface is contained in a hyperplane. Assuming further smoothness (e.g. twice differentiable) we show that union of any family of hyperplanes that covers the hypersurface has maximal possible Hausdorff dimension. We also define and study a notion of degeneracy of embedded C 1 vector bundles over a C 1 submanifold and show as a corollary that if the base manifold has at least one non inflection point then codiagonal of any C 1 line bundle over it has positive Lebesgue measure. Finally we show that codiagonal of any line bundle over an n dimensional ellipsoid or a convex curve has non empty interior, and the same assertion also holds for any non tangent line bundle over a hyperplane.


Near Optimal High Probability Complexity Bounds for Non Smooth Stochastic Optimization with Heavy Tailed Noise. Thanks to their practical efficiency and random nature of the data, stochastic first order methods are standard for training large scale machine learning models. Random behavior may cause a particular run of an algorithm to result in a highly suboptimal objective value, whereas theoretical guarantees are usually proved for the expectation of the objective value. Thus, it is essential to theoretically guarantee that algorithms provide small objective residual with high probability. Existing methods for non smooth stochastic convex optimization have complexity bounds with the dependence on the confidence level that is either negative power or logarithmic but under an additional assumption of sub Gaussian (light tailed) noise distribution that may not hold in practice, e.g., in several NLP tasks. In our paper, we resolve this issue and derive the first high probability convergence results with logarithmic dependence on the confidence level for non smooth convex stochastic optimization problems with non sub Gaussian (heavy tailed) noise. To derive our results, we propose novel stepsize rules for two stochastic methods with gradient clipping. Moreover, our analysis works for generalized smooth objectives with H "older continuous gradients, and for both methods, we provide an extension for strongly convex problems. Finally, our results imply that the first (accelerated) method we consider also has optimal iteration and oracle complexity in all the regimes, and the second one is optimal in the non smooth setting.


The defocusing nonlinear Schr "odinger equation with step like oscillatory initial data. We study the Cauchy problem for the defocusing nonlinear Schr "odinger (NLS) equation under the assumption that the solution vanishes as x to infty and approaches an oscillatory plane wave as x to infty . We first develop an inverse scattering transform formalism for solutions satisfying such step like boundary conditions. Using this formalism, we prove that there exists a global solution of the corresponding Cauchy problem and establish a representation for this solution in terms of the solution of a Riemann Hilbert problem. By performing a steepest descent analysis of this Riemann Hilbert problem, we identify three asymptotic sectors in the half plane t geq 0 of the xt plane and derive asymptotic formulas for the solution in each of these sectors. Finally, by restricting the constructed solutions to the half line x geq 0 , we find a class of solutions with asymptotically time periodic boundary values previously sought for in the context of the NLS half line problem.


Platicon microcomb generation using laser self injection locking. The past decade has witnessed major advances in the development of microresonator based frequency combs (microcombs) that are broadband optical frequency combs with repetition rates in the millimeter wave to microwave domain. Integrated microcombs can be manufactured using wafer scale process and have been applied in numerous applications. Most of these advances are based on the harnessing of dissipative Kerr solitons (DKS) in optical microresonators with anomalous group velocity dispersion (GVD). However, microcombs can also be generated with normal GVD using dissipative localized structures that are referred to as "dark pulse", "switching wave" or "platicon". Importantly, as most materials feature intrinsic normal GVD, the requirement of dispersion engineering is significantly relaxed for platicon generation. Therefore while DKS microcombs require particular designs and fabrication processes, platicon microcombs can be readily built using standard CMOS compatible platforms such as thin film (i.e. typically below 300 nm) Si3N4. Yet laser self injection locking that has been recently used to create highly compact integrated DKS microcomb modules has not been demonstrated for platicons. Here we report the first fully integrated platicon microcomb operating at a microwave K band repetition rate. Using laser self injection locking of a DFB laser edge coupled to a Si3N4 microresonator, platicons are electrically initiated and stably maintained, enabling a compact microcomb module without any complex control. We further characterize the phase noise of the platicon repetition rate and the pumping laser. The observation of self injection locked platicons facilitates future wide adoption of microcombs as a build in block in standard photonic integrated architectures via commercial foundry service.


PoissonSeg Semi Supervised Few Shot Medical Image Segmentation via Poisson Learning. The application of deep learning to medical image segmentation has been hampered due to the lack of abundant pixel level annotated data. Few shot Semantic Segmentation (FSS) is a promising strategy for breaking the deadlock. However, a high performing FSS model still requires sufficient pixel level annotated classes for training to avoid overfitting, which leads to its performance bottleneck in medical image segmentation due to the unmet need for annotations. Thus, semi supervised FSS for medical images is accordingly proposed to utilize unlabeled data for further performance improvement. Nevertheless, existing semi supervised FSS methods has two obvious defects (1) neglecting the relationship between the labeled and unlabeled data (2) using unlabeled data directly for end to end training leads to degenerated representation learning. To address these problems, we propose a novel semi supervised FSS framework for medical image segmentation. The proposed framework employs Poisson learning for modeling data relationship and propagating supervision signals, and Spatial Consistency Calibration for encouraging the model to learn more coherent representations. In this process, unlabeled samples do not involve in end to end training, but provide supervisory information for query image segmentation through graph based learning. We conduct extensive experiments on three medical image segmentation datasets (i.e. ISIC skin lesion segmentation, abdominal organs segmentation for MRI and abdominal organs segmentation for CT) to demonstrate the state of the art performance and broad applicability of the proposed framework.


Structural analysis of an all purpose question answering model. Attention is a key component of the now ubiquitous pre trained language models. By learning to focus on relevant pieces of information, these Transformer based architectures have proven capable of tackling several tasks at once and sometimes even surpass their single task counterparts. To better understand this phenomenon, we conduct a structural analysis of a new all purpose question answering model that we introduce. Surprisingly, this model retains single task performance even in the absence of a strong transfer effect between tasks. Through attention head importance scoring, we observe that attention heads specialize in a particular task and that some heads are more conducive to learning than others in both the multi task and single task settings.


Automated Driver Testing for Small Footprint Embedded Systems. Embedded systems represent a billionaire market and are present in most of the processors produced in the world.Embedded software interacts with external peripherals such as sensors and actuators through drivers. The strong interaction between drivers and external peripherals often hamper embedded software development, in special the testing task, giving that the physical environment may not be deterministic and difficult to be recreated during the tests, the hardware may not be available or its presence may not be desirable or costly. Aiming at addressing these problems, this paper introduces a solution to test drivers on microcontrollers, based on a method that uses three components a Device Under Test (DUT), a Double device, and a computer. The computer runs a test orchestration code, while the DUT runs the test target code, and the Double plays the role of the real external peripherals that interact with the DUT. The proposed solution was successfully implemented and validated using different protocols.


Uniform approximation of continuous couplings. We study the approximation of non negative multi variate couplings in the uniform norm while matching given single variable marginal constraints.


Towards Self Adaptive Metric Learning On the Fly. Good quality similarity metrics can significantly facilitate the performance of many large scale, real world applications. Existing studies have proposed various solutions to learn a Mahalanobis or bilinear metric in an online fashion by either restricting distances between similar (dissimilar) pairs to be smaller (larger) than a given lower (upper) bound or requiring similar instances to be separated from dissimilar instances with a given margin. However, these linear metrics learned by leveraging fixed bounds or margins may not perform well in real world applications, especially when data distributions are complex. We aim to address the open challenge of "Online Adaptive Metric Learning" (OAML) for learning adaptive metric functions on the fly. Unlike traditional online metric learning methods, OAML is significantly more challenging since the learned metric could be non linear and the model has to be self adaptive as more instances are observed. In this paper, we present a new online metric learning framework that attempts to tackle the challenge by learning an ANN based metric with adaptive model complexity from a stream of constraints. In particular, we propose a novel Adaptive Bound Triplet Loss (ABTL) to effectively utilize the input constraints and present a novel Adaptive Hedge Update (AHU) method for online updating the model parameters. We empirically validate the effectiveness and efficacy of our framework on various applications such as real world image classification, facial verification, and image retrieval.


(AF)2 S3Net Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Network. Autonomous robotic systems and self driving cars rely on accurate perception of their surroundings as the safety of the passengers and pedestrians is the top priority. Semantic segmentation is one the essential components of environmental perception that provides semantic information of the scene. Recently, several methods have been introduced for 3D LiDAR semantic segmentation. While, they can lead to improved performance, they are either afflicted by high computational complexity, therefore are inefficient, or lack fine details of smaller instances. To alleviate this problem, we propose AF2 S3Net, an end to end encoder decoder CNN network for 3D LiDAR semantic segmentation. We present a novel multi branch attentive feature fusion module in the encoder and a unique adaptive feature selection module with feature map re weighting in the decoder. Our AF2 S3Net fuses the voxel based learning and point based learning into a single framework to effectively process the large 3D scene. Our experimental results show that the proposed method outperforms the state of the art approaches on the large scale SemanticKITTI benchmark, ranking 1st on the competitive public leaderboard competition upon publication.


Error bounded Approximate Time Series Joins using Compact Dictionary Representations of Time Series. The matrix profile is an effective data mining tool that provides similarity join functionality for time series data. Users of the matrix profile can either join a time series with itself using intra similarity join (i.e., self join) or join a time series with another time series using inter similarity join. By invoking either or both types of joins, the matrix profile can help users discover both conserved and anomalous structures in the data. Since the introduction of the matrix profile five years ago, multiple efforts have been made to speed up the computation with approximate joins however, the majority of these efforts only focus on self joins. In this work, we show that it is possible to efficiently perform approximate inter time series similarity joins with error bounded guarantees by creating a compact "dictionary" representation of time series. Using the dictionary representation instead of the original time series, we are able to improve the throughput of an anomaly mining system by at least 20X, with essentially no decrease in accuracy. As a side effect, the dictionaries also summarize the time series in a semantically meaningful way and can provide intuitive and actionable insights. We demonstrate the utility of our dictionary based inter time series similarity joins on domains as diverse as medicine and transportation.


The RSNA ASNR MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification. The BraTS 2021 challenge celebrates its 10th anniversary and is jointly organized by the Radiological Society of North America (RSNA), the American Society of Neuroradiology (ASNR), and the Medical Image Computing and Computer Assisted Interventions (MICCAI) society. Since its inception, BraTS has been focusing on being a common benchmarking venue for brain glioma segmentation algorithms, with well curated multi institutional multi parametric magnetic resonance imaging (mpMRI) data. Gliomas are the most common primary malignancies of the central nervous system, with varying degrees of aggressiveness and prognosis. The RSNA ASNR MICCAI BraTS 2021 challenge targets the evaluation of computational algorithms assessing the same tumor compartmentalization, as well as the underlying tumor's molecular characterization, in pre operative baseline mpMRI data from 2,040 patients. Specifically, the two tasks that BraTS 2021 focuses on are a) the segmentation of the histologically distinct brain tumor sub regions, and b) the classification of the tumor's O 6 methylguanine DNA methyltransferase (MGMT) promoter methylation status. The performance evaluation of all participating algorithms in BraTS 2021 will be conducted through the Sage Bionetworks Synapse platform (Task 1) and Kaggle (Task 2), concluding in distributing to the top ranked participants monetary awards of 60,000 collectively.


A version of the inexact Levenberg Marquardt method for constrained nonsmooth equations. We herein propose a variant of the projected inexact Levenberg Marquardt method (ILMM) for solving constrained nonsmooth equations. Since the orthogonal projection onto the feasible set may be computationally expensive, we propose a local ILMM with feasible inexact projections. By using assumption of semi smoothness and an error bound condition which is weaker than the standard full rank assumption, we establish its convergence results, including results on its rate. Finally, some computacional results are reported in order to illustrate the advantages of the new schemes.


Mach Number Dependence of Flow Instability around a Spiked Body. A forward facing aerospike have been identified as a passive flow control device for enhancing the aerodynamic efficiency and reducing the heat transfer in high speed flows. In addition, it has been reported that the presence of a spike brings in unsteadiness in the form of oscillation and pulsation to the structure. Previous researchers have investigated the aerothermodynamic coefficients, together with offering a detailed explanation of the flow physics and associated unsteadiness, and their dependence on the spike's geometric characteristics (spike nose, and length to fore body diameter ratio, L D). This work focuses on ascertaining the role of flow speeds (free stream Mach number), and their energy content, in governing the physics around a spiked body, which is yet to be established. Numerical investigation has been carried out using axisymmetric Navier Stokes laminar flow solver for Mach number range of 2.0 to 7.0. A round tip spike with flat face cylindrical after body have been simulated for spike length ratio of L D 2.0, with spike diameter to fore body diameter of 0.1. The flow unsteadiness has been analyzed with drag and pressure coefficients variation at different Mach numbers. It was found that the flow field around the spiked blunt nose behaves in pulsation mode at lower Mach numbers 2, 3 and transition to oscillatory mode at higher Mach numbers 5, 6 and 7, while remain almost stable at Mach 4. The limit of Strouhal Number for characterizing the pulsation and oscillation modes at various Mach numbers for spike length of L D 2 with flat after body is observed as 0.2, however it may very well depend on other geometric parameters of spike and after body.


Sign of the solutions of linear fractional differential equations and some applications. In this work we wish to highlight some consequences of a recent result proved in N. D. Cong and H. T. Tuan, Generation of nonlocal fractional dynamical systems by fractional differential equations, J. Integral Equations Appl. 29 (2017), no. 4, 585 608 . Particular emphasis will be given to its application on fractional variational problems of Herglotz type.


LaLaLoc Latent Layout Localisation in Dynamic, Unvisited Environments. We present LaLaLoc to localise in environments without the need for prior visitation, and in a manner that is robust to large changes in scene appearance, such as a full rearrangement of furniture. Specifically, LaLaLoc performs localisation through latent representations of room layout. LaLaLoc learns a rich embedding space shared between RGB panoramas and layouts inferred from a known floor plan that encodes the structural similarity between locations. Further, LaLaLoc introduces direct, cross modal pose optimisation in its latent space. Thus, LaLaLoc enables fine grained pose estimation in a scene without the need for prior visitation, as well as being robust to dynamics, such as a change in furniture configuration. We show that in a domestic environment LaLaLoc is able to accurately localise a single RGB panorama image to within 8.3cm, given only a floor plan as a prior.


Pose GNN Camera Pose Estimation System Using Graph Neural Networks. We propose a novel image based localization system using graph neural networks (GNN). The pretrained ResNet50 convolutional neural network (CNN) architecture is used to extract the important features for each image. Following, the extracted features are input to GNN to find the pose of each image by either using the image features as a node in a graph and formulate the pose estimation problem as node pose regression or modelling the image features themselves as a graph and the problem becomes graph pose regression. We do an extensive comparison between the proposed two approaches and the state of the art single image localization methods and show that using GNN leads to enhanced performance for both indoor and outdoor environments.


One dimensional martingale rearrangement couplings. We are interested in martingale rearrangement couplings. As introduced by Wiesel 37 in order to prove the stability of Martingale Optimal Transport problems, these are projections in adapted Wasserstein distance of couplings between two probability measures on the real line in the convex order onto the set of martingale couplings between these two marginals. In reason of the lack of relative compactness of the set of couplings with given marginals for the adapted Wasserstein topology, the existence of such a projection is not clear at all. Under a barycentre dispersion assumption on the original coupling which is in particular satisfied by the Hoeffding Fr 'echet or comonotone coupling, Wiesel gives a clear algorithmic construction of a martingale rearrangement when the marginals are finitely supported and then gets rid of the finite support assumption by relying on a rather messy limiting procedure to overcome the lack of relative compactness. Here, we give a direct general construction of a martingale rearrangement coupling under the barycentre dispersion assumption. This martingale rearrangement is obtained from the original coupling by an approach similar to the construction we gave in 24 of the inverse transform martingale coupling, a member of a family of martingale couplings close to the Hoeffding Fr 'echet coupling, but for a slightly different injection in the set of extended couplings introduced by Beiglb "ock and Juillet 9 and which involve the uniform distribution on 0, 1 in addition to the two marginals. We last discuss the stability in adapted Wassertein distance of the inverse transform martingale coupling with respect to the marginal distributions.


Homology of strict omega categories. In this dissertation, we compare the "classical" homology of an omega category (defined as the homology of its Street nerve) with its polygraphic homology. More precisely, we prove that both homologies generally do not coincide and call homologically coherent the particular strict omega categories for which polygraphic homology and homology of the nerve do coincide. The goal pursued is to find abstract and concrete criteria to detect homologically coherent omega categories. For example, we prove that all (small) categories, considered as strict omega categories with unit cells above dimension 1, are homologically coherent. We also introduce the notion of bubble free 2 category and conjecture that a cofibrant 2 category is homologically coherent if and only if it is bubble free. We also prove important results concerning free strict omega categories on polygraphs (also known as computads), such as the fact that if F is a discrete Conduch 'e omega functor from C to D and if D is a free strict omega category on a polygraph, then so is C. Overall, this thesis achieves to build a general framework in which to study the homology of strict omega categories using tools of abstract homotopical algebra such as Quillen's theory of model categories or Grothendieck's theory of derivators.


Gamma Compactness of Some Classes of Integral Functionals Depending on Vector Fields. In this paper we achieve some Gamma compactness results for suitable classes of integral functionals depending on a given family of Lipschitz vector fields, with respect to both the strong L p topology and the strong W X 1,p topology.


A combinatorial model for the transition matrix between the Specht and web bases. We introduce a new class of permutations, called web permutations. Using these permutations, we provide a combinatorial interpretation for entries of the transition matrix between the Specht and web bases, which answers Rhoades's question. Furthermore, we study enumerative properties of these permutations.


Functorial Language Models. We introduce functorial language models a principled way to compute probability distributions over word sequences given a monoidal functor from grammar to meaning. This yields a method for training categorical compositional distributional (DisCoCat) models on raw text data. We provide a proof of concept implementation in DisCoPy, the Python toolbox for monoidal categories.


Sharp interface limit of an anisotropic Ginzburg Landau equation. In this work, we study the co dimensional 1 interface limit of an anisotropic Ginzburg Landau equation under parabolic scalings. This is a semi linear parabolic system of a planar vector field with a small parameter varepsilon 0 corresponding to the transition layer width. For well prepared initial datum, as varepsilon tends to 0 , we show the solution gradient will concentrate on a closed simple curve evolving by curve shortening flow. Moreover, the limiting solution satisfies an anchoring boundary condition when restricted on the curve. These results hold as long as the limiting curvature flow remains smooth. The main ingredient of the proof is an estimate of the level set of the quasi distance function corresponding to the solution.


Nonlinear Transform Source Channel Coding for Semantic Communications. In this paper, we propose a new class of high efficient deep joint source channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear transform source channel coding (NTSCC). In the considered model, the transmitter first learns a nonlinear analysis transform to map the source data into latent space, then transmits the latent representation to the receiver via deep joint source channel coding. Our model incorporates the nonlinear transform as a strong prior to effectively extract the source semantic features and provide side information for source channel coding. Unlike existing conventional deep joint source channel coding methods, the proposed NTSCC essentially learns both the source latent representation and an entropy model as the prior on the latent representation. Accordingly, novel adaptive rate transmission and hyperprior aided codec refinement mechanisms are developed to upgrade deep joint source channel coding. The whole system design is formulated as an optimization problem whose goal is to minimize the end to end transmission rate distortion performance under established perceptual quality metrics. Across simple example sources and test image sources, we find that the proposed NTSCC transmission method generally outperforms both the analog transmission using the standard deep joint source channel coding and the classical separation based digital transmission. Notably, the proposed NTSCC method can potentially support future semantic communications due to its vigorous content aware ability.


Joint ergodicity of sequences. A collection of integer sequences is jointly ergodic if for every ergodic measure preserving system the multiple ergodic averages, with iterates given by this collection of sequences, converge in the mean to the product of the integrals. We give necessary and sufficient conditions for joint ergodicity that are flexible enough to recover most of the known examples of jointly ergodic sequences and also allow us to answer some related open problems. An interesting feature of our arguments is that they avoid deep tools from ergodic theory that were previously used to establish similar results. Our approach is primarily based on an ergodic variant of a technique pioneered by Peluse and Prendiville in order to give quantitative variants for the finitary version of the polynomial Szemer 'edi theorem.


A Graph based approach to derive the geodesic distance on Statistical manifolds Application to Multimedia Information Retrieval. In this paper, we leverage the properties of non Euclidean Geometry to define the Geodesic distance (GD) on the space of statistical manifolds. The Geodesic distance is a real and intuitive similarity measure that is a good alternative to the purely statistical and extensively used Kullback Leibler divergence (KLD). Despite the effectiveness of the GD, a closed form does not exist for many manifolds, since the geodesic equations are hard to solve. This explains that the major studies have been content to use numerical approximations. Nevertheless, most of those do not take account of the manifold properties, which leads to a loss of information and thus to low performances. We propose an approximation of the Geodesic distance through a graph based method. This latter permits to well represent the structure of the statistical manifold, and respects its geometrical properties. Our main aim is to compare the graph based approximation to the state of the art approximations. Thus, the proposed approach is evaluated for two statistical manifolds, namely the Weibull manifold and the Gamma manifold, considering the Content Based Texture Retrieval application on different databases.


Clusters in Markov Chains via Singular Vectors of Laplacian Matrices. Suppose that T is a stochastic matrix. We propose an algorithm for identifying clusters in the Markov chain associated with T . The algorithm is recursive in nature, and in order to identify clusters, it uses the sign pattern of a left singular vector associated with the second smallest singular value of the Laplacian matrix I T. We prove a number of results that justify the algorithm's approach, and illustrate the algorithm's performance with several numerical examples.


Toward Efficient Transfer Learning in 6G. 6G networks will greatly expand the support for data oriented, autonomous applications for over the top (OTT) and networking use cases. The success of these use cases will depend on the availability of big data sets which is not practical in many real scenarios due to the highly dynamic behavior of systems and the cost of data collection procedures. Transfer learning (TL) is a promising approach to deal with these challenges through the sharing of knowledge among diverse learning algorithms. with TL, the learning rate and learning accuracy can be considerably improved. However, there are implementation challenges to efficiently deploy and utilize TL in 6G. In this paper, we initiate this discussion by providing some performance metrics to measure the TL success. Then, we show how infrastructure, application, management, and training planes of 6G can be adapted to handle TL. We provide examples of TL in 6G and highlight the spatio temporal features of data in 6G that can lead to efficient TL. By simulation results, we demonstrate how transferring the quantized neural network weights between two use cases can make a trade off between overheads and performance and attain more efficient TL in 6G. We also provide a list of future research directions in TL for 6G.


FaDIV Syn Fast Depth Independent View Synthesis. We introduce FaDIV Syn, a fast depth independent method for novel view synthesis. Related methods are often limited by their depth estimation stage, where incorrect depth predictions can lead to large projection errors. To avoid this issue, we efficiently warp input images into the target frame for a range of assumed depth planes. The resulting plane sweep volume (PSV) is directly fed into our network, which first estimates soft PSV masks in a self supervised manner, and then directly produces the novel output view. We therefore side step explicit depth estimation. This improves efficiency and performance on transparent, reflective, thin, and feature less scene parts. FaDIV Syn can perform both interpolation and extrapolation tasks and outperforms state of the art extrapolation methods on the large scale RealEstate10k dataset. In contrast to comparable methods, it achieves real time performance due to its lightweight architecture. We thoroughly evaluate ablations, such as removing the Soft Masking network, training from fewer examples as well as generalization to higher resolutions and stronger depth discretization.


Graph Neural Networks in Real Time Fraud Detection with Lambda Architecture. Transaction checkout fraud detection is an essential risk control components for E commerce marketplaces. In order to leverage graph networks to decrease fraud rate efficiently and guarantee the information flow passed through neighbors only from the past of the checkouts, we first present a novel Directed Dynamic Snapshot (DDS) linkage design for graph construction and a Lambda Neural Networks (LNN) architecture for effective inference with Graph Neural Networks embeddings. Experiments show that our LNN on DDS graph, outperforms baseline models significantly and is computational efficient for real time fraud detection.


Social Media Polarization and Echo Chambers in the Context of COVID 19 Case Study. Background Social media chatter in 2020 has been largely dominated by the COVID 19 pandemic. Existing research shows that COVID 19 discourse is highly politicized, with political preferences linked to beliefs and disbeliefs about the virus. As it happens with topics that become politicized, people may fall into echo chambers, which is the idea that one is only presented with information they already agree with, thereby reinforcing one's confirmation bias. Understanding the relationship between information dissemination and political preference is crucial for effective public health communication. Objective We aimed to study the extent of polarization and examine the structure of echo chambers related to COVID 19 discourse on Twitter in the United States. Methods First, we presented Retweet BERT, a scalable and highly accurate model for estimating user polarity by leveraging language features and network structures. Then, by analyzing the user polarity predicted by Retweet BERT, we provided new insights into the characterization of partisan users. Results We observed that right leaning users were noticeably more vocal and active in the production and consumption of COVID 19 information. We also found that most of the highly influential users were partisan, which may contribute to further polarization. Importantly, while echo chambers exist in both the right and left leaning communities, the right leaning community was by far more densely connected within their echo chamber and isolated from the rest. Conclusions We provided empirical evidence that political echo chambers are prevalent, especially in the right leaning community, which can exacerbate the exposure to information in line with pre existing users' views. Our findings have broader implications in developing effective public health campaigns and promoting the circulation of factual information online.


Frequency comb distillation for optical superchannel transmission. Optical frequency combs can potentially provide an efficient light source for multi terabit per second optical superchannels. However, as the bandwidth of these multi wavelength light sources is increased, it can result in low per line power. Optical amplifiers can be used to overcome power limitations, but the accompanying spontaneous optical noise can degrade performance in optical systems. To overcome this, we demonstrate wideband noise reduction for comb lines using a high Q microring resonator whose resonances align with the comb lines, providing tight optical filtering of multiple combs lines at the same time. By distilling an optical frequency comb in this way, we are able to reduce the required comb line OSNR when these lines are used in a coherent optical communications system. Through performance tests on a 19.45 GHz spaced comb generating 71 lines, using 18 Gbaud, 64 QAM sub channels at a spectral efficiency of 10.6 b s Hz, we find that noise corrupted comb lines can reduce the optical signal to noise ratio required for the comb by 9 dB when used as optical carriers at the transmitter side, and by 12 dB when used as a local oscillator at the receiver side. This demonstration provides a method to enable low power optical frequency combs to be able to support high bandwidth and high capacity communications.


Analysis of nested multilevel Monte Carlo using approximate Normal random variables. The multilevel Monte Carlo (MLMC) method has been used for a wide variety of stochastic applications. In this paper we consider its use in situations in which input random variables can be replaced by similar approximate random variables which can be computed much more cheaply. A nested MLMC approach is adopted in which a two level treatment of the approximated random variables is embedded within a standard MLMC application. We analyse the resulting nested MLMC variance in the specific context of an SDE discretisation in which Normal random variables can be replaced by approximately Normal random variables, and provide numerical results to support the analysis.


Building Mental Models through Preview of Autopilot Behaviors. Effective human vehicle collaboration requires an appropriate un derstanding of vehicle behavior for safety and trust. Improvingon our prior work by adding a future prediction module, we in troduce our framework, calledAutoPreview, to enable humans topreview autopilot behaviors prior to direct interaction with thevehicle. Previewing autopilot behavior can help to ensure smoothhuman vehicle collaboration during the initial exploration stagewith the vehicle. To demonstrate its practicality, we conducted acase study on human vehicle collaboration and built a prototypeof our framework with the CARLA simulator. Additionally, weconducted a between subject control experiment (n 10) to studywhether ourAutoPreviewframework can provide a deeper under standing of autopilot behavior compared to direct interaction. Ourresults suggest that theAutoPreviewframework does, in fact, helpusers understand autopilot behavior and develop appropriate men tal models


Efficient implementation of characteristic based schemes on unstructured triangular grids. Using characteristics to treat advection terms in time dependent PDEs leads to a class of schemes, e.g., semi Lagrangian and Lagrange Galerkin schemes, which preserve stability under large Courant numbers, and may therefore be appealing in many practical situations. Unfortunately, the need of locating the feet of characteristics may cause a serious drop of efficiency in the case of unstructured space grids, and thus prevent the use of large time step schemes on complex geometries. In this paper, we perform an in depth analysis of the main recipes available for characteristic location, and propose a technique to improve the efficiency of this phase, using additional information related to the advecting vector field. This results in a clear improvement of execution times in the unstructured case, thus extending the range of applicability of large time step schemes.


SST GNN Simplified Spatio temporal Traffic forecasting model using Graph Neural Network. To capture spatial relationships and temporal dynamics in traffic data, spatio temporal models for traffic forecasting have drawn significant attention in recent years. Most of the recent works employed graph neural networks(GNN) with multiple layers to capture the spatial dependency. However, road junctions with different hop distance can carry distinct traffic information which should be exploited separately but existing multi layer GNNs are incompetent to discriminate between their impact. Again, to capture the temporal interrelationship, recurrent neural networks are common in state of the art approaches that often fail to capture long range dependencies. Furthermore, traffic data shows repeated patterns in a daily or weekly period which should be addressed explicitly. To address these limitations, we have designed a Simplified Spatio temporal Traffic forecasting GNN(SST GNN) that effectively encodes the spatial dependency by separately aggregating different neighborhood representations rather than with multiple layers and capture the temporal dependency with a simple yet effective weighted spatio temporal aggregation mechanism. We capture the periodic traffic patterns by using a novel position encoding scheme with historical and current data in two different models. With extensive experimental analysis, we have shown that our model has significantly outperformed the state of the art models on three real world traffic datasets from the Performance Measurement System (PeMS).


Cats vs. Spectre An Axiomatic Approach to Modeling Speculative Execution Attacks. The Spectre family of speculative execution attacks have required a rethinking of formal methods for security. Approaches based on operational speculative semantics have made initial inroads towards finding vulnerable code and validating defenses. However, with each new attack grows the amount of microarchitectural detail that has to be integrated into the underlying semantics. We propose an alternative, light weight and axiomatic approach to specifying speculative semantics that relies on insights from memory models for concurrency. We use the CAT modeling language for memory consistency to specify execution models that capture speculative control flow, store to load forwarding, predictive store forwarding, and memory ordering machine clears. We present a bounded model checking framework parametrized by our speculative CAT models and evaluate its implementation against the state of the art. Due to the axiomatic approach, our models can be rapidly extended to allow our framework to detect new types of attacks and validate defenses against them.


Back to Reality for Imitation Learning. Imitation learning, and robot learning in general, emerged due to breakthroughs in machine learning, rather than breakthroughs in robotics. As such, evaluation metrics for robot learning are deeply rooted in those for machine learning, and focus primarily on data efficiency. We believe that a better metric for real world robot learning is time efficiency, which better models the true cost to humans. This is a call to arms to the robot learning community to develop our own evaluation metrics, tailored towards the long term goals of real world robotics.


A General Gaussian Heatmap Label Assignment for Arbitrary Oriented Object Detection. Recently, many arbitrary oriented object detection (AOOD) methods have been proposed and attracted widespread attention in many fields. However, most of them are based on anchor boxes or standard Gaussian heatmaps. Such label assignment strategy may not only fail to reflect the shape and direction characteristics of arbitrary oriented objects, but also have high parameter tuning efforts. In this paper, a novel AOOD method called General Gaussian Heatmap Label Assignment (GGHL) is proposed. Specifically, an anchor free object adaptation label assignment (OLA) strategy is presented to define the positive candidates based on two dimensional (2 D) oriented Gaussian heatmaps, which reflect the shape and direction features of arbitrary oriented objects. Based on OLA, an oriented bounding box (OBB) representation component (ORC) is developed to indicate OBBs and adjust the Gaussian center prior weights to fit the characteristics of different objects adaptively through neural network learning. Moreover, a joint optimization loss (JOL) with area normalization and dynamic confidence weighting is designed to refine the misalign optimal results of different subtasks. Extensive experiments on public datasets demonstrate that the proposed GGHL improves the AOOD performance with low parameter tuning and time costs. Furthermore, it is generally applicable to most AOOD methods to improve their performance including lightweight models on embedded platforms.


Deep Learning for IoT. Deep learning and other machine learning approaches are deployed to many systems related to Internet of Things or IoT. However, it faces challenges that adversaries can take loopholes to hack these systems through tampering history data. This paper first presents overall points of adversarial machine learning. Then, we illustrate traditional methods, such as Petri Net cannot solve this new question efficiently. To help IoT data analysis more efficient, we propose a retrieval method based on deep learning (recurrent neural network). Besides, this paper presents a research on data retrieval solution to avoid hacking by adversaries in the fields of adversary machine leaning. It further directs the new approaches in terms of how to implementing this framework in IoT settings based on adversarial deep learning.


DarkLighter Light Up the Darkness for UAV Tracking. Recent years have witnessed the fast evolution and promising performance of the convolutional neural network (CNN) based trackers, which aim at imitating biological visual systems. However, current CNN based trackers can hardly generalize well to low light scenes that are commonly lacked in the existing training set. In indistinguishable night scenarios frequently encountered in unmanned aerial vehicle (UAV) tracking based applications, the robustness of the state of the art (SOTA) trackers drops significantly. To facilitate aerial tracking in the dark through a general fashion, this work proposes a low light image enhancer namely DarkLighter, which dedicates to alleviate the impact of poor illumination and noise iteratively. A lightweight map estimation network, i.e., ME Net, is trained to efficiently estimate illumination maps and noise maps jointly. Experiments are conducted with several SOTA trackers on numerous UAV dark tracking scenes. Exhaustive evaluations demonstrate the reliability and universality of DarkLighter, with high efficiency. Moreover, DarkLighter has further been implemented on a typical UAV system. Real world tests at night scenes have verified its practicability and dependability.


Quadratic Payments with constrained probabilities. Dealing with quadratic payments, marginal probability is usually considered ideally constant, maybe for the sake of initial simplicity. Considering the voting scenario depicted in "Quadratic Payments A Primer" by Vitalik Buterin, firstly its math foundations are made explicit. Developing a simple referendum model, more realistic outcome probability and marginal probability qualitative shapes are introduced. Enforcing seemingly reasonable assumptions, quadratic payments are then generalized to take into account these new functions shapes, and the way they are still quadratic is discussed. Closing remarks underline the emerging of trade off constraints not existing in ideal case.


Borel Colouring Bad Sequences. Every better quasi order codifies a Borel graph that does not contain a copy of the shift graph. It is known that there is a better quasi order that codes a Borel graph with infinite Borel chromatic number, though one has yet to be explicitly constructed. In this paper, we show that examples cannot be constructed via standard methods. Moreover, we show that most of the known better quasi orders are non examples, suggesting there is still a class of better quasi orders with interesting combinatorial properties who's elements members still remain unknown.


Graph Contrastive Clustering. Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and clustering objective into consideration, thus the learned representations are not optimal for clustering and the performance might be limited. Towards this issue, we first propose a novel graph contrastive learning framework, which is then applied to the clustering task and we come up with the Graph Constrastive Clustering (GCC) method. Different from basic contrastive clustering that only assumes an image and its augmentation should share similar representation and clustering assignments, we lift the instance level consistency to the cluster level consistency with the assumption that samples in one cluster and their augmentations should all be similar. Specifically, on the one hand, the graph Laplacian based contrastive loss is proposed to learn more discriminative and clustering friendly features. On the other hand, a novel graph based contrastive learning strategy is proposed to learn more compact clustering assignments. Both of them incorporate the latent category information to reduce the intra cluster variance while increasing the inter cluster variance. Experiments on six commonly used datasets demonstrate the superiority of our proposed approach over the state of the art methods.


High order accurate schemes for Maxwell's equations with nonlinear active media and material interfaces. We describe a fourth order accurate finite difference time domain scheme for solving dispersive Maxwell's equations with nonlinear multi level carrier kinetics models. The scheme is based on an efficient single step three time level modified equation approach for Maxwell's equations in second order form for the electric field coupled to ODEs for the polarization vectors and population densities of the atomic levels. The resulting scheme has a large CFL one time step. Curved interfaces between different materials are accurately treated with curvilinear grids and compatibility conditions. A novel hierarchical modified equation approach leads to an explicit scheme that does not require any nonlinear iterations. The hierarchical approach at interfaces leads to local updates at the interface with no coupling in the tangential directions. Complex geometry is treated with overset grids. Numerical stability is maintained using high order upwind dissipation designed for Maxwell's equations in second order form. The scheme is carefully verified for a number of two and three dimensional problems. The resulting numerical model with generalized dispersion and arbitrary nonlinear multi level system can be used for many plasmonic applications such as for ab initio time domain modeling of nonlinear engineered materials for nanolasing applications, where nano patterned plasmonic dispersive arrays are used to enhance otherwise weak nonlinearity in the active media.


Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models. Embedding based methods are popular for Knowledge Base Question Answering (KBQA), but few current models have numerical reasoning skills and thus struggle to answer ordinal constrained questions. This paper proposes a new embedding based KBQA framework which particularly takes numerical reasoning into account. We present NumericalTransformer on top of NSM, a state of the art embedding based KBQA model, to create NT NSM. To enable better training, we propose two pre training tasks with explicit numerical oriented loss functions on two generated training datasets and a template based data augmentation method for enriching ordinal constrained QA dataset. Extensive experiments on KBQA benchmarks demonstrate that with the help of our training algorithm, NT NSM is empowered with numerical reasoning skills and substantially outperforms the baselines in answering ordinal constrained questions.


AutoMeKin2021 An open source program for automated reaction discovery. AutoMeKin2021 is an updated version of tsscds2018, a program for the automated discovery of reaction mechanisms (J. Comput. Chem. 2018, 39, 1922 1930). This release features a number of new capabilities rare event molecular dynamics simulations to enhance reaction discovery, extension of the original search algorithm to study van der Waals complexes, use of chemical knowledge, a new search algorithm based on bond order time series analysis, statistics of the chemical reaction networks, a web application to submit jobs, and other features. The source code, manual, installation instructions and the website link are available at https rxnkin.usc.es index.php AutoMeKin


On the infinitesimal generator of an optimal state semigroup. In this article we fully describe the domain of the infinitesimal generator of the optimal state semigroup which arises in the theory of the linear quadratic problem for a specific class of boundary control systems. This represents an improvement over earlier work of the authors, joint with Lasiecka, where a set inclusion was established, but not an equality. The novel part of the proof of this result developes through appropriate asymptotic estimates that take advantage of the regularity analysis carried out in the study of the optimization problem, while the powers of positive operators and interpolation are still key tools. We also attest to the validity of an assumed relation between two significant parameters in the case of distinct systems of coupled hyperbolic parabolic partial differential equations which are pertinent to the underlying framework.


Regime Switching Entropic Risk Measures on Crude Oil Pricing. This paper introduces a new type of risk measures, namely regime switching entropic risk measures, and study their applicability through simulations. The state of the economy is incorporated into the entropic risk formulation by using a Markov chain. Closed formulae of the risk measure are obtained for futures on crude oil derivatives. The applicability of these new types of risk measures is based on the study of the risk aversion parameter and the convenience yield. The numerical results show a term structure and a mean reverting behavior of the convenience yield.


The Three Ensemble Clustering (3EC) Algorithm for Pattern Discovery in Unsupervised Learning. This paper presents a multiple learner algorithm called the 'Three Ensemble Clustering 3EC' algorithm that classifies unlabeled data into quality clusters as a part of unsupervised learning. It offers the flexibility to explore the context of new clusters formed by an ensemble of algorithms based on internal validation indices. It is worth mentioning that the input data set is considered to be a cluster of clusters. An anomaly can possibly manifest as a cluster as well. Each partitioned cluster is considered to be a new data set and is a candidate to explore the most optimal algorithm and its number of partition splits until a predefined stopping criteria is met. The algorithms independently partition the data set into clusters and the quality of the partitioning is assessed by an ensemble of internal cluster validation indices. The 3EC algorithm presents the validation index scores from a choice of algorithms and its configuration of partitions and it is called the Tau Grid. 3EC chooses the most optimal score. The 3EC algorithm owes its name to the two input ensembles of algorithms and internal validation indices and an output ensemble of final clusters. Quality plays an important role in this clustering approach and it also acts as a stopping criteria from further partitioning. Quality is determined based on the quality of the clusters provided by an algorithm and its optimal number of splits. The 3EC algorithm determines this from the score of the ensemble of validation indices. The user can configure the stopping criteria by providing quality thresholds for the score range of each of the validation indices and the optimal size of the output cluster. The users can experiment with different sets of stopping criteria and choose the most 'sensible group' of quality clusters