On the identification of the nonlinearity parameter in the Westervelt equation from boundary measurements. We consider an undetermined coefficient inverse problem for a non linear partial differential equation occurring in high intensity ultrasound propagation as used in acoustic tomography. In particular, we investigate the recovery of the nonlinearity coefficient commonly labeled as B A in the literature which is part of a space dependent coefficient kappa in the Westervelt equation governing nonlinear acoustics. Corresponding to the typical measurement setup, the overposed data consists of time trace measurements on some zero or one dimensional set Sigma representing the receiving transducer array. After an analysis of the map from kappa to the overposed data, we show injectivity of its linearisation and use this as motivation for several iterative schemes to recover kappa . Numerical simulations will also be shown to illustrate the efficiency of the methods.


Session aware Linear Item Item Models for Session based Recommendation. Session based recommendation aims at predicting the next item given a sequence of previous items consumed in the session, e.g., on e commerce or multimedia streaming services. Specifically, session data exhibits some unique characteristics, i.e., session consistency and sequential dependency over items within the session, repeated item consumption, and session timeliness. In this paper, we propose simple yet effective linear models for considering the holistic aspects of the sessions. The comprehensive nature of our models helps improve the quality of session based recommendation. More importantly, it provides a generalized framework for reflecting different perspectives of session data. Furthermore, since our models can be solved by closed form solutions, they are highly scalable. Experimental results demonstrate that the proposed linear models show competitive or state of the art performance in various metrics on several real world datasets.


Maximal L 1 regularity for solutions to inhomogeneous incompressible Navier Stokes equations. This paper is devoted to the maximal L 1 regularity and asymptotic behavior for solutions to the inhomogeneous incompressible Navier Stokes equations under a scaling invariant smallness assumption on the initial velocity. We obtain a new global L 1 in time estimate for the Lipschitz seminorm of the velocity field without any smallness assumption on the initial density fluctuation. In the derivation of this estimate, we study the maximal L 1 regularity for a linear Stokes system with variable coefficients. The analysis tools are a use of the semigroup generated by a generalized Stokes operator to characterize some Besov norms and a new gradient estimate for a class of second order elliptic equations of divergence form. Our method might be used to study some other issues arising from incompressible or compressible viscous fluids.


Revealing the canalizing structure of Boolean functions Algorithms and applications. Boolean functions can be represented in many ways including logical forms, truth tables, and polynomials. Additionally, Boolean functions have different canonical representations such as minimal disjunctive normal forms. Other canonical representation is based on the polynomial representation of Boolean functions where they can be written as a nested product of canalizing layers and a polynomial that contains the noncanalizing variables. In this paper we study the problem of identifying the canalizing layers format of Boolean functions. First, we show that the problem of finding the canalizing layers is NP hard. Second, we present several algorithms for finding the canalizing layers of a Boolean function, discuss their complexities, and compare their performances. Third, we show applications where the computation of canalizing layers can be used for finding a disjunctive normal form of a nested canalizing function. Another application deals with the reverse engineering of Boolean networks with a prescribed layering format. Finally, implementations of our algorithms in Python and in the computer algebra system Macaulay2 are available at https github.com ckadelka BooleanCanalization.


Convergence of random attractors towards deterministic singleton attractor for 2D and 3D convective Brinkman Forchheimer equations. This work deals with the asymptotic behavior of the two as well as three dimensional convective Brinkman Forchheimer (CBF) equations in periodic domains frac partial boldsymbol u partial t mu Delta boldsymbol u ( boldsymbol u cdot nabla) boldsymbol u alpha boldsymbol u beta boldsymbol u r 1 boldsymbol u nabla p boldsymbol f , nabla cdot boldsymbol u 0, where r geq1 . We prove that the global attractor of the above system is a singleton under small forcing intensity ( r geq 1 for n 2 and r geq 3 for n 3 with 2 beta mu geq 1 for r n 3 ). After perturbing the above system with additive or multiplicative white noise, the random attractor does not have a singleton structure. But we obtain that the random attractor for 2D stochastic CBF equations with additive and multiplicative white noise converges towards the deterministic singleton attractor for 1 leq r leq 2 and 1 leq r infty , respectively, when the coefficient of random perturbation converges to zero (upper and lower semicontinuity). Interestingly in the case of 3D stochastic CBF equations perturbed by multiplicative white noise, we are able to establish that the random attractor converges towards the deterministic singleton attractor for 3 leq r leq 5 ( 2 beta mu geq 1 for r 3 ), when the coefficient of random perturbation converges to zero.


Effects of the initial perturbations on the Rayleigh Taylor Kelvin Helmholtz instability system. In the paper, the effects of initial perturbations on the Rayleigh Taylor instability (RTI), Kelvin Helmholtz instability (KHI), and the coupled Rayleigh Taylor Kelvin Helmholtz instability (RTKHI) systems are investigated using a multiple relaxation time discrete Boltzmann model. Six different perturbation interfaces are designed to study the effects of the initial perturbations on the instability systems. Based on the mean heat flux strength D 3,1 , the effects of initial interfaces on the coupled RTKHI are examined in detail. The research is focused on two aspects (i) the main mechanism in the early stage of the RTKHI, (ii) the transition point from KHI like to RTI like for the case where the KHI dominates at earlier time and the RTI dominates at later time. It is found that the early main mechanism is related to the shape of the initial interface, which is represented by both the bilateral contact angle theta 1 and the middle contact angle theta 2 . The influence of inverted parabolic and inverted ellipse perturbations ( theta 1 90 ) on the transition point of the RTKHI system is greater than that of other interfaces.


Non isothermal viscoelastic flows with conservation laws and relaxation. We propose a system of conservation laws with relaxation source terms (i.e. balance laws) for non isothermal viscoelastic flows of Maxwell fluids. The system is an extension of the polyconvex elastodynamics of hyperelastic bodies using additional structure variables. It is obtained by writing the Helmholtz free energy as the sum of a volumetric energy density (function of the determinant of the deformation gradient det F and the temperature theta like the standard perfect gas law or Noble Abel stiffened gas law) plus a polyconvex strain energy density function of F, theta and of symmetric positive definite structure tensors that relax at a characteristic time scale. One feature of our model is that it unifies various ideal materials ranging from hyperelastic solids to perfect fluids, encompassing fluids with memory like Maxwell fluids. We establish a strictly convex mathematical entropy to show that the system is symmetric hyperbolic. Another feature of the proposed model is therefore the short time existence and uniqueness of smooth solutions, which define genuinely causal viscoelastic flows with waves propagating at finite speed. In heat conductors, we complement the system by a Maxwell Cattaneo equation for an energy flux variable. The system is still symmetric hyperbolic, and smooth evolutions with finite speed waves remain well defined.


Turbulence explains the accelerations of an eagle in natural flight. Turbulent winds and gusts fluctuate on a wide range of timescales from milliseconds to minutes and longer, a range that overlaps the timescales of avian flight behavior, yet the importance of turbulence to avian behavior is unclear. By combining wind speed data with the measured accelerations of a golden eagle (Aquila chrysaetos) flying in the wild, we show that the eagle's accelerations can be explained by a linear interaction with turbulence for timescales between about 1 2 and 10 s. These timescales are comparable to those of typical eagle behaviors, corresponding to between about 1 and 25 wingbeats, and to those of turbulent gusts both larger than the eagle's wingspan and smaller than large scale atmospheric phenomena such as convection cells. The eagle's accelerations exhibit power spectra and intermittent activity characteristic of turbulence, and increase in proportion to the turbulence intensity. Intermittency results in accelerations that are occasionally several times stronger than gravity, and much larger than the ones we experience while driving, for instance. These imprints of turbulence on the bird's movements need to be further explored to understand the energetics of birds and other volant lifeforms, to improve our own methods of flying through ceaselessly turbulent environments, and to engage airborne wildlife as distributed probes of the changing conditions in the atmosphere.


Mixed Integer Programming for the ROADEF EURO 2020 challenge. The ROADEF 2020 challenge presents a maintenance scheduling problem from the French electricity grid company RTE. The modeling of uncertainty makes the problem highly nonconvex and apparently out of the reach of mathematical solvers. We present our approach for the challenge problem. It is based on a new family of cutting planes, coupled with a constraint generation approach. We present mathematical proofs and separation algorithms for the cutting planes. We then study the practical impact of our additions on the challenge instances, showing that our approach significantly reduces the optimality gap obtained by the solver.


Towards Parallel CFD computation for the ADAPT framework. In order to run Computational Fluid Dynamics (CFD) codes on large scale infrastructures, parallel computing has to be used because of the computational intensive nature of the problems. In this paper we investigate the ADAPT platform where we couple flow Partial Differential Equations and a Poisson equation. This leads to a linear system which we solve using direct methods. The implementation deals with the MUMPS parallel multi frontal direct solver and mesh partitioning methods using METIS to improve the performance of the framework. We also investigate, in this paper, how the mesh partitioning methods are able to optimize the mesh cell distribution for the ADAPT solver. The experience gained in this paper facilitates the move to the 3D version of ADAPT and the move to a Service Oriented view of ADAPT as future work.


Note on induced paths in sparse random graphs. We show that for d ge d 0( epsilon) , with high probability, the random graph G(n,d n) contains an induced path of length (3 2 epsilon) frac n d log d . This improves a result obtained independently by Luczak and Suen in the early 90s, and answers a question of Fernandez de la Vega. Along the way, we generalize a recent result of Cooley, Dragani 'c, Kang and Sudakov who studied the analogous problem for induced matchings.


A conditional, a fuzzy and a probabilistic interpretation of self organising maps. In this paper we establish a link between fuzzy and preferential semantics for description logics and Self Organising Maps, which have been proposed as possible candidates to explain the psychological mechanisms underlying category generalisation. In particular, we show that the input output behavior of a Self Organising Map after training can be described by a fuzzy description logic interpretation as well as by a preferential interpretation, based on a concept wise multipreference semantics, which takes into account preferences with respect to different concepts and has been recently proposed for ranked and for weighted defeasible description logics. Properties of the network can be proven by model checking on the fuzzy or on the preferential interpretation. Starting from the fuzzy interpretation, we also provide a probabilistic account for this neural network model.


Are we ready for beyond application high volume data? The Reeds robot perception benchmark dataset. This paper presents a dataset, called Reeds, for research on robot perception algorithms. The dataset aims to provide demanding benchmark opportunities for algorithms, rather than providing an environment for testing application specific solutions. A boat was selected as a logging platform in order to provide highly dynamic kinematics. The sensor package includes six high performance vision sensors, two long range lidars, radar, as well as GNSS and an IMU. The spatiotemporal resolution of sensors were maximized in order to provide large variations and flexibility in the data, offering evaluation at a large number of different resolution presets based on the resolution found in other datasets. Reeds also provides means of a fair and reproducible comparison of algorithms, by running all evaluations on a common server backend. As the dataset contains massive scale data, the evaluation principle also serves as a way to avoid moving data unnecessarily. It was also found that naive evaluation of algorithms, where each evaluation is computed sequentially, was not practical as the fetch and decode task of each frame would not scale well. Instead, each frame is only decoded once and then fed to all algorithms in parallel, including for GPU based algorithms.


New notion of nonuniform exponential dichotomy with applications to the theory of pullback and forward attractors. In this work we study nonuniform exponential dichotomies and existence of pullback and forward attractors for evolution processes associated to nonautonomous differential equations. We define a new concept of nonuniform exponential dichotomy, for which we provide several examples, study the relation with the standard notion, and establish a robustness under perturbations. We provide a dynamical interpretation of admissibility pairs related with exponential dichotomies to obtain existence of pullback and forward attractors. We apply these abstract results for ordinary and parabolic differential equations.


Gossip over Holonomic Graphs. A gossip process is an iterative process in a multi agent system where only two neighboring agents communicate at each iteration and update their states. The neighboring condition is by convention described by an undirected graph. In this paper, we consider a general update rule whereby each agent takes an arbitrary weighted average of its and its neighbor's current states. In general, the limit of the gossip process (if it converges) depends on the order of iterations of the gossiping pairs. The main contribution of the paper is to provide a necessary and sufficient condition for convergence of the gossip process that is independent of the order of iterations. This result relies on the introduction of the novel notion of holonomy of local stochastic matrices for the communication graph. We also provide complete characterizations of the limit and the space of holonomic stochastic matrices over the graph.


Bilateral Personalized Dialogue Generation with Contrastive Learning. Generating personalized responses is one of the major challenges in natural human robot interaction. Current researches in this field mainly focus on generating responses consistent with the robot's pre assigned persona, while ignoring the user's persona. Such responses may be inappropriate or even offensive, which may lead to the bad user experience. Therefore, we propose a Bilateral Personalized Dialogue Generation (BPDG) method for dyadic conversation, which integrates user and robot personas into dialogue generation via designing a dynamic persona aware fusion method. To bridge the gap between the learning objective function and evaluation metrics, the Conditional Mutual Information Maximum (CMIM) criterion is adopted with contrastive learning to select the proper response from the generated candidates. Moreover, a bilateral persona accuracy metric is designed to measure the degree of bilateral personalization. Experimental results demonstrate that, compared with several state of the art methods, the final results of the proposed method are more personalized and consistent with bilateral personas in terms of both automatic and manual evaluations.


Seismic interferometry from correlated noise sources. It is a well established principle that cross correlating seismic observations at different receiver locations can yield estimates of band limited inter receiver Green's functions. This principle, known as seismic interferometry, is a powerful technique that can transform noise into signals which allow us to remotely image and interrogate subsurface Earth structures. In practice it is often necessary and even desirable to rely on noise already present in the environment. Theory that underpins many applications of ambient noise interferometry makes an assumption that the noise sources are uncorrelated in space and time. However, many real world noise sources such as trains, highway traffic and ocean waves are inherently correlated both in space and time, in direct contradiction to the current theoretical foundations. Applying standard interferometric techniques to recordings from correlated energy sources makes the Green's function liable to estimation errors that so far have not been fully accounted for theoretically nor in practice. We show that these errors are significant for common noise sources, always perturbing and sometimes obscuring the phase one wishes to retrieve. Our analysis explains why stacking may reduce the phase errors, but also shows that in commonly encountered circumstances stacking will not remediate the problem. This analytical insight allowed us to develop a novel workflow that significantly mitigates effects arising from the use of correlated noise sources. Our methodology can be used in conjunction with already existing approaches, and improves results from both correlated and uncorrelated ambient noise. Hence, we expect it to be widely applicable in real life ambient noise studies.


Improving bounds on prime counting functions by partial verification of the Riemann hypothesis. Using a recent verification of the Riemann hypothesis up to height 3 cdot 10 12 , we provide strong estimates on pi(x) and other prime counting functions for finite ranges of x . In particular, we get that pi(x) text li (x) sqrt x log x 8 pi for 2657 leq x leq 1.101 cdot 10 26 . We also provide weaker bounds that hold for a wider range of x , and an application to an inequality of Ramanujan.


Small space and streaming pattern matching with k edits. In this work, we revisit the fundamental and well studied problem of approximate pattern matching under edit distance. Given an integer k , a pattern P of length m , and a text T of length n ge m , the task is to find substrings of T that are within edit distance k from P . Our main result is a streaming algorithm that solves the problem in tilde O (k 5) space and tilde O (k 8) amortised time per character of the text, providing answers correct with high probability. (Hereafter, tilde O ( cdot) hides a mathrm poly ( log n) factor.) This answers a decade old question since the discovery of a mathrm poly (k log n) space streaming algorithm for pattern matching under Hamming distance by Porat and Porat FOCS 2009 , the existence of an analogous result for edit distance remained open. Up to this work, no mathrm poly (k log n) space algorithm was known even in the simpler semi streaming model, where T comes as a stream but P is available for read only access. In this model, we give a deterministic algorithm that achieves slightly better complexity. In order to develop the fully streaming algorithm, we introduce a new edit distance sketch parametrised by integers n ge k . For any string of length at most n , the sketch is of size tilde O (k 2) and it can be computed with an tilde O (k 2) space streaming algorithm. Given the sketches of two strings, in tilde O (k 3) time we can compute their edit distance or certify that it is larger than k . This result improves upon tilde O (k 8) size sketches of Belazzougui and Zhu FOCS 2016 and very recent tilde O (k 3) size sketches of Jin, Nelson, and Wu STACS 2021 .


Impact of Facial Tattoos and Paintings on Face Recognition Systems. In the past years, face recognition technologies have shown impressive recognition performance, mainly due to recent developments in deep convolutional neural networks. Notwithstanding those improvements, several challenges which affect the performance of face recognition systems remain. In this work, we investigate the impact that facial tattoos and paintings have on current face recognition systems. To this end, we first collected an appropriate database containing image pairs of individuals with and without facial tattoos or paintings. The assembled database was used to evaluate how facial tattoos and paintings affect the detection, quality estimation, as well as the feature extraction and comparison modules of a face recognition system. The impact on these modules was evaluated using state of the art open source and commercial systems. The obtained results show that facial tattoos and paintings affect all the tested modules, especially for images where a large area of the face is covered with tattoos or paintings. Our work is an initial case study and indicates a need to design algorithms which are robust to the visual changes caused by facial tattoos and paintings.


Some variations on an extension of Caratheodory's normality criterion. In this note we give some variations on an extension of Caratheodory's normality criterion due to Grahl and Nevo.


Geometrically Constrained Trajectory Optimization for Multicopters. We present an optimization based framework for multicopter trajectory planning subject to geometrical configuration constraints and user defined dynamic constraints. The basis of the framework is a novel trajectory representation built upon our novel optimality conditions for unconstrained control effort minimization. We design linear complexity operations on this representation to conduct spatial temporal deformation under various planning requirements. Smooth maps are utilized to exactly eliminate geometrical constraints in a lightweight fashion. A variety of state input constraints are supported by the decoupling of dense constraint evaluation from sparse parameterization, and backward differentiation of flatness map. As a result, this framework transforms a generally constrained multicopter planning problem into an unconstrained optimization that can be solved reliably and efficiently. Our framework bridges the gaps among solution quality, planning efficiency, and constraint fidelity for a multicopter with limited resources and maneuvering capability. Its generality and robustness are both demonstrated by applications to different flight tasks. Extensive simulations and benchmarks are also conducted to show its capability of generating high quality solutions while retaining the computation speed against other specialized methods by orders of magnitude. The source code of our framework is available at https github.com ZJU FAST Lab GCOPTER


A Taxonomy of Live Migration Management in Cloud Computing. Cloud Data Centers have become the backbone infrastructure to provide services. With the emerging edge computing paradigm, computation and networking capabilities have been pushed from clouds to the edge to provide computation, intelligence, networking management with low end to end latency. Service migration across different computing nodes in edge and cloud computing becomes essential to guarantee the quality of service in the dynamic environment. Many studies have been conducted on the dynamic resource management involving migrating Virtual Machines to achieve various objectives, such as load balancing, consolidation, performance, energy saving, and disaster recovery. Some have investigated to improve and predict the performance of single live migration of VM and container. Recently, several studies service migration in the edge centric computing paradigms. However, there is a lack of surveys to focus on the live migration management in edge and cloud computing environments. We examine the characteristics of each field and conduct a migration management centric taxonomy and survey. We also identify the gap and research opportunities to guarantee the performance of resource management with live migrations.


Asymptotic Analysis of Max Min Weighted SINR for IRS Assisted MISO Systems with Hardware Impairments. We focus on the realistic maximization of the uplink minimum signal to interference plus noise ratio (SINR) of a general multiple input single output (MISO) system assisted by an intelligent reflecting surface (IRS) in the large system limit accounting for HIs. In particular, we introduce the HIs at both the IRS (IRS HIs) and the transceiver HIs (AT HIs), usually neglected despite their inevitable impact. Specifically, the deterministic equivalent analysis enables the derivation of the asymptotic weighted maximum minimum SINR with HIs by jointly optimizing the HIs aware receiver, the transmit power, and the reflect beamforming matrix (RBM). Notably, we obtain the optimal power allocation and reflect beamforming matrix with low overhead instead of their frequent necessary computation in conventional MIMO systems based on the instantaneous channel information. Monte Carlo simulations verify the analytical results which show the insightful interplay among the key parameters and the degradation of the performance due to HIs.


Collision of elastic drop with thin cylinder. The collision of water and elastic liquid drops with a thin cylinder (thread) is studied. The droplet flight trajectory and the cylinder axis are mutually perpendicular. Attention is focused on the difference between collisions of water drops and drops of elastic fluids. In the experiments, the drop diameter was 3 mm, the diameter of horizontal stainless steel cylinders was 0.4 and 0.8 mm. The drops were formed by slowly pumping liquid through a vertical stainless steel capillary with an outer diameter of 0.8 mm, from which droplets were periodically detached under the action of gravity. The droplet velocity before collision was defined by the distance between the capillary cut and the target (cylinder) in experiments, this distance was approximately 5, 10, and 20 mm. The drop velocities before impact are estimated in the range of 0.2 0.5 m s. The collision process was monitored by high speed video recording methods with a frame rate of 240 and 960 Hz. The test liquids were water and aqueous solutions of polyacrylamide of molecular weight 11 million and concentrations of 100 and 1000 ppm (PAM 100 and PAM 1k). Experiments have shown that, depending on the drop impact height and polymer concentration, different scenarios of a drop collision with a thin cylinder are possible a short term recoil of a drop from an obstacle, a drop flowing around a cylindrical obstacle while maintaining the continuity of the drop, the breakup of a drop into two secondary drops, one of which can continue flight and the other one is captured by the cylinder, or both secondary droplets continue to fly, the drop also can be captured by the cylinder, until the impact of the next drop(s) forces the accumulated drop detach from the cylinder. Numerical modeling satisfactorily reproduces the phenomena observed in the experiment.


Convergence Voting From Pairwise Comparisons to Consensus. An important aspect of AI design and ethics is to create systems that reflect aggregate preferences of the society. To this end, the techniques of social choice theory are often utilized. We propose a new social choice function motivated by the PageRank algorithm. The function ranks voting options based on the Condorcet graph of pairwise comparisons. To this end, we transform the Condorcet graph into a Markov chain whose stationary distribution provides the scores of the options. We show how the values in the stationary distribution can be interpreted as quantified aggregate support for the voting options, to which the community of voters converges through an imaginary sequence of negotiating steps. Because of that, we suggest the name "convergence voting" for the new voting scheme, and "negotiated community support" for the resulting stationary allocation of scores. Our social choice function can be viewed as a consensus voting method, sitting somewhere between Copeland and Borda. On the one hand, it does not necessarily choose the Condorcet winner, as strong support from a part of the society can outweigh mediocre uniform support. On the other hand, the influence of unpopular candidates on the outcome is smaller than in the primary technique of consensus voting, i.e., the Borda count. We achieve that without having to introduce an ad hoc weighting that some other methods do.


Ultra High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval. The semantic matching capabilities of neural information retrieval can ameliorate synonymy and polysemy problems of symbolic approaches. However, neural models' dense representations are more suitable for re ranking, due to their inefficiency. Sparse representations, either in symbolic or latent form, are more efficient with an inverted index. Taking the merits of the sparse and dense representations, we propose an ultra high dimensional (UHD) representation scheme equipped with directly controllable sparsity. UHD's large capacity and minimal noise and interference among the dimensions allow for binarized representations, which are highly efficient for storage and search. Also proposed is a bucketing method, where the embeddings from multiple layers of BERT are selected merged to represent diverse linguistic aspects. We test our models with MS MARCO and TREC CAR, showing that our models outperforms other sparse models


Representation of professions in entertainment media Insights into frequency and sentiment trends through computational text analysis. Societal ideas and trends dictate media narratives and cinematic depictions which in turn influences people's beliefs and perceptions of the real world. Media portrayal of culture, education, government, religion, and family affect their function and evolution over time as people interpret and perceive these representations and incorporate them into their beliefs and actions. It is important to study media depictions of these social structures so that they do not propagate or reinforce negative stereotypes, or discriminate against any demographic section. In this work, we examine media representation of professions and provide computational insights into their incidence, and sentiment expressed, in entertainment media content. We create a searchable taxonomy of professional groups and titles to facilitate their retrieval from speaker agnostic text passages like movie and television (TV) show subtitles. We leverage this taxonomy and relevant natural language processing (NLP) models to create a corpus of professional mentions in media content, spanning more than 136,000 IMDb titles over seven decades (1950 2017). We analyze the frequency and sentiment trends of different occupations, study the effect of media attributes like genre, country of production, and title type on these trends, and investigate if the incidence of professions in media subtitles correlate with their real world employment statistics. We observe increased media mentions of STEM, arts, sports, and entertainment occupations in the analyzed subtitles, and a decreased frequency of manual labor jobs and military occupations. The sentiment expressed toward lawyers, police, and doctors is becoming negative over time, whereas astronauts, musicians, singers, and engineers are mentioned favorably. Professions that employ more people have increased media frequency, supporting our hypothesis that media acts as a mirror to society.


A General Framework for Debiasing in CTR Prediction. Most of the existing methods for debaising in click through rate (CTR) prediction depend on an oversimplified assumption, i.e., the click probability is the product of observation probability and relevance probability. However, since there is a complicated interplay between these two probabilities, these methods cannot be applied to other scenarios, e.g. query auto completion (QAC) and route recommendation. We propose a general debiasing framework without simplifying the relationships between variables, which can handle all scenarios in CTR prediction. Simulation experiments show that under the simplest scenario, our method maintains a similar AUC with the state of the art methods in other scenarios, our method achieves considerable improvements compared with existing methods. Meanwhile, in online experiments, the framework also gains significant improvements consistently.


Rational integrals of 2 dimensional geodesic flows new examples. This paper is devoted to searching for Riemannian metrics on 2 surfaces whose geodesic flows admit a rational in momenta first integral with a linear numerator and denominator. The explicit examples of metrics and such integrals are constructed. Few superintegrable systems are found having both a polynomial and a rational integrals which are functionally independent of the Hamiltonian.


Fiber full modules and a local freeness criterion for local cohomology modules. Let R be a finitely generated positively graded algebra over a Noetherian local ring B , and mathfrak m R be the graded irrelevant ideal of R . We provide a local criterion characterizing the B freeness of all the local cohomology modules text H mathfrak m i(M) of a finitely generated graded R module M . We show that fiber full modules are exactly the ones that satisfy this criterion. When we change B by an arbitrary Noetherian ring A , we study the fiber full locus of a module in text Spec (A) we show that the fiber full locus is always an open subset of text Spec (A) and that it is dense when A is generically reduced.


Maneuver Aware Pooling for Vehicle Trajectory Prediction. Autonomous vehicles should be able to predict the future states of its environment and respond appropriately. Specifically, predicting the behavior of surrounding human drivers is vital for such platforms to share the same road with humans. Behavior of each of the surrounding vehicles is governed by the motion of its neighbor vehicles. This paper focuses on predicting the behavior of the surrounding vehicles of an autonomous vehicle on highways. We are motivated by improving the prediction accuracy when a surrounding vehicle performs lane change and highway merging maneuvers. We propose a novel pooling strategy to capture the inter dependencies between the neighbor vehicles. Depending solely on Euclidean trajectory representation, the existing pooling strategies do not model the context information of the maneuvers intended by a surrounding vehicle. In contrast, our pooling mechanism employs polar trajectory representation, vehicles orientation and radial velocity. This results in an implicitly maneuver aware pooling operation. We incorporated the proposed pooling mechanism into a generative encoder decoder model, and evaluated our method on the public NGSIM dataset. The results of maneuver based trajectory predictions demonstrate the effectiveness of the proposed method compared with the state of the art approaches. Our "Pooling Toolbox" code is available at https github.com m hasan n pooling.


Class Agnostic Segmentation Loss and Its Application to Salient Object Detection and Segmentation. In this paper we present a novel loss function, called class agnostic segmentation (CAS) loss. With CAS loss the class descriptors are learned during training of the network. We don't require to define the label of a class a priori, rather the CAS loss clusters regions with similar appearance together in a weakly supervised manner. Furthermore, we show that the CAS loss function is sparse, bounded, and robust to class imbalance. We first apply our CAS loss function with fully convolutional ResNet101 and DeepLab v3 architectures to the binary segmentation problem of salient object detection. We investigate the performance against the state of the art methods in two settings of low and high fidelity training data on seven salient object detection datasets. For low fidelity training data (incorrect class label) class agnostic segmentation loss outperforms the state of the art methods on salient object detection datasets by staggering margins of around 50 . For high fidelity training data (correct class labels) class agnostic segmentation models perform as good as the state of the art approaches while beating the state of the art methods on most datasets. In order to show the utility of the loss function across different domains we then also test on general segmentation dataset, where class agnostic segmentation loss outperforms competing losses by huge margins.


Detecting and Mitigating Network Packet Overloads on Real Time Devices in IoT Systems. Manufacturing, automotive, and aerospace environments use embedded systems for control and automation and need to fulfill strict real time guarantees. To facilitate more efficient business processes and remote control, such devices are being connected to IP networks. Due to the difficulty in predicting network packets and the interrelated workloads of interrupt handlers and drivers, devices controlling time critical processes stand under the risk of missing process deadlines when under high network loads. Additionally, devices at the edge of large networks and the internet are subject to a high risk of load spikes and network packet overloads. In this paper, we investigate strategies to detect network packet overloads in real time and present four approaches to adaptively mitigate local deadline misses. In addition to two strategies mitigating network bursts with and without hysteresis, we present and discuss two novel mitigation algorithms, called Budget and Queue Mitigation. In an experimental evaluation, all algorithms showed mitigating effects, with the Queue Mitigation strategy enabling most packet processing while preventing lateness of critical tasks.


Wild holomorphic foliations of the ball. We prove that the open unit ball mathbb B n of mathbb C n (n ge 2) admits a nonsingular holomorphic foliation mathcal F by closed complex hypersurfaces such that both the union of the complete leaves of mathcal F and the union of the incomplete leaves of mathcal F are dense subsets of mathbb B n . In particular, every leaf of mathcal F is both a limit of complete leaves of mathcal F and a limit of incomplete leaves of mathcal F . This gives the first example of a holomorphic foliation of mathbb B n by connected closed complex hypersurfaces having a complete leaf that is a limit of incomplete ones. We obtain an analogous result for foliations by complex submanifolds of arbitrary pure codimension q with 1 le q n .


Perfect and nearly perfect separation dimension of complete and random graphs. The separation dimension of a hypergraph G is the smallest natural number d for which there is an embedding of G into mathbb R d , such that any pair of disjoint edges is separated by some hyperplane normal to one of the axes. The perfect separation dimension further requires that any pair of disjoint edges is separated by the same amount of such (pairwise nonparallel) hyperplanes. While it is known that for any fixed r ge 2 , the separation dimension of any n vertex r graph is O( log n) , the perfect separation dimension is much larger. In fact, no polynomial upper bound for the perfect separation dimension of r uniform hypergraphs is known. In our first result we essentially resolve the case r 2 , i.e. graphs. We prove that the perfect separation dimension of K n is linear in n , up to a small polylogarithmic factor. In fact, we prove it is at least n 2 1 and at most n( log n) 1 o(1) . Our second result proves that the perfect separation dimension of almost all graphs is also linear in n , up to a logarithmic factor. This follows as a special case of a more general result showing that the perfect separation dimension of the random graph G(n,p) is w.h.p. Omega(n p log n) for a wide range of values of p , including all constant p . Finally, we prove that significantly relaxing perfection to just requiring that any pair of disjoint edges of K n is separated the same number of times up to a difference of c log n for some absolute constant c , still requires the dimension to be Omega(n) . This is perhaps surprising as it is known that if we allow a difference of 7 log 2 n , then the dimension reduces to O( log n) .


Coreference Aware Dialogue Summarization. Summarizing conversations via neural approaches has been gaining research traction lately, yet it is still challenging to obtain practical solutions. Examples of such challenges include unstructured information exchange in dialogues, informal interactions between speakers, and dynamic role changes of speakers as the dialogue evolves. Many of such challenges result in complex coreference links. Therefore, in this work, we investigate different approaches to explicitly incorporate coreference information in neural abstractive dialogue summarization models to tackle the aforementioned challenges. Experimental results show that the proposed approaches achieve state of the art performance, implying it is useful to utilize coreference information in dialogue summarization. Evaluation results on factual correctness suggest such coreference aware models are better at tracing the information flow among interlocutors and associating accurate status actions with the corresponding interlocutors and person mentions.


TAAC Temporally Abstract Actor Critic for Continuous Control. We present temporally abstract actor critic (TAAC), a simple but effective off policy RL algorithm that incorporates closed loop temporal abstraction into the actor critic framework. TAAC adds a second stage binary policy to choose between the previous action and a new action output by an actor. Crucially, its "act or repeat" decision hinges on the actually sampled action instead of the expected behavior of the actor. This post acting switching scheme let the overall policy make more informed decisions. TAAC has two important features a) persistent exploration, and b) a new compare through Q operator for multi step TD backup, specially tailored to the action repetition scenario. We demonstrate TAAC's advantages over several strong baselines across 14 continuous control tasks. Our surprising finding reveals that while achieving top performance, TAAC is able to "mine" a significant number of repeated actions with the trained policy even on continuous tasks whose problem structures on the surface seem to repel action repetition. This suggests that aside from encouraging persistent exploration, action repetition can find its place in a good policy behavior. Code is available at https github.com hnyu taac.


Neuron Campaign for Initialization Guided by Information Bottleneck Theory. Initialization plays a critical role in the training of deep neural networks (DNN). Existing initialization strategies mainly focus on stabilizing the training process to mitigate gradient vanish explosion problems. However, these initialization methods are lacking in consideration about how to enhance generalization ability. The Information Bottleneck (IB) theory is a well known understanding framework to provide an explanation about the generalization of DNN. Guided by the insights provided by IB theory, we design two criteria for better initializing DNN. And we further design a neuron campaign initialization algorithm to efficiently select a good initialization for a neural network on a given dataset. The experiments on MNIST dataset show that our method can lead to a better generalization performance with faster convergence.


Domain Consistency Regularization for Unsupervised Multi source Domain Adaptive Classification. Deep learning based multi source unsupervised domain adaptation (MUDA) has been actively studied in recent years. Compared with single source unsupervised domain adaptation (SUDA), domain shift in MUDA exists not only between the source and target domains but also among multiple source domains. Most existing MUDA algorithms focus on extracting domain invariant representations among all domains whereas the task specific decision boundaries among classes are largely neglected. In this paper, we propose an end to end trainable network that exploits domain Consistency Regularization for unsupervised Multi source domain Adaptive classification (CRMA). CRMA aligns not only the distributions of each pair of source and target domains but also that of all domains. For each pair of source and target domains, we employ an intra domain consistency to regularize a pair of domain specific classifiers to achieve intra domain alignment. In addition, we design an inter domain consistency that targets joint inter domain alignment among all domains. To address different similarities between multiple source domains and the target domain, we design an authorization strategy that assigns different authorities to domain specific classifiers adaptively for optimal pseudo label prediction and self training. Extensive experiments show that CRMA tackles unsupervised domain adaptation effectively under a multi source setup and achieves superior adaptation consistently across multiple MUDA datasets.


A plane wave method based on approximate wave directions for two dimensional Helmholtz equations with large wave numbers. In this paper we present and analyse a high accuracy method for computing wave directions defined in the geometrical optics ansatz of Helmholtz equation with variable wave number. Then we define an "adaptive" plane wave space with small dimensions, in which each plane wave basis function is determined by such an approximate wave direction. We establish a best L 2 approximation of the plane wave space for the analytic solutions of homogeneous Helmholtz equations with large wave numbers and report some numerical results to illustrate the efficiency of the proposed method.


A Step Toward More Inclusive People Annotations for Fairness. The Open Images Dataset contains approximately 9 million images and is a widely accepted dataset for computer vision research. As is common practice for large datasets, the annotations are not exhaustive, with bounding boxes and attribute labels for only a subset of the classes in each image. In this paper, we present a new set of annotations on a subset of the Open Images dataset called the MIAP (More Inclusive Annotations for People) subset, containing bounding boxes and attributes for all of the people visible in those images. The attributes and labeling methodology for the MIAP subset were designed to enable research into model fairness. In addition, we analyze the original annotation methodology for the person class and its subclasses, discussing the resulting patterns in order to inform future annotation efforts. By considering both the original and exhaustive annotation sets, researchers can also now study how systematic patterns in training annotations affect modeling.


Kac Rice formula for transverse intersections. We prove a generalized Kac Rice formula that, in a well defined regular setting, computes the expected cardinality of the preimage of a submanifold via a random map, by expressing it as the integral of a density. Our proof starts from scratch and although it follows the guidelines of the standard proofs of Kac Rice formula, it contains some new ideas coming from the point of view of measure theory. Generalizing further, we extend this formula to any other type of counting measure, such as the intersection degree. We discuss in depth the specialization to smooth Gaussian random sections of a vector bundle. Here, the formula computes the expected number of points where the section meets a given submanifold of the total space, it holds under natural non degeneracy conditions and can be simplified by using appropriate connections. Moreover, we point out a class of submanifolds, that we call sub Gaussian, for which the formula is locally finite and depends continuously with respect to the covariance of the first jet. In particular, this applies to any notion of singularity of sections that can be defined as the set of points where the jet prolongation meets a given semialgebraic submanifold of the jet space. Various examples of applications and special cases are discussed. In particular, we report a new proof of the Poincar 'e kinematic formula for homogeneous spaces and we observe how the formula simplifies for isotropic Gaussian fields on the sphere.


Searching for Singularities in Navier Stokes Flows Based on the Ladyzhenskaya Prodi Serrin Conditions. In this investigation we perform a systematic computational search for potential singularities in 3D Navier Stokes flows based on the Ladyzhenskaya Prodi Serrin conditions. They assert that if the quantity int 0 T mathbf u (t) L q( Omega) p , dt , where 2 p 3 q le 1 , q 3 , is bounded, then the solution mathbf u (t) of the Navier Stokes system is smooth on the interval 0,T . In other words, if a singularity should occur at some time t in 0,T , then this quantity must be unbounded. We have probed this condition by studying a family of variational PDE optimization problems where initial conditions mathbf u 0 are sought to maximize int 0 T mathbf u (t) L 4( Omega) 8 , dt for different T subject to suitable constraints. These problems are solved numerically using a large scale adjoint based gradient approach. Even in the flows corresponding to the optimal initial conditions determined in this way no evidence has been found for singularity formation, which would be manifested by unbounded growth of mathbf u (t) L 4( Omega) . However, the maximum enstrophy attained in these extreme flows scales in proportion to mathcal E 0 3 2 , the same as found by Kang et al. (2020) when maximizing the finite time growth of enstrophy. In addition, we also consider sharpness of an a priori estimate on the time evolution of mathbf u (t) L 4( Omega) by solving another PDE optimization problem and demonstrate that the upper bound in this estimate could be improved.


Refined Coxeter polynomials. Coxeter polynomials are important homological invariants that are defined for a large class of finite dimensional algebras. It is of particular interest to develop methods to compute these polynomials. We define the notion of insertion of a poset into a triangular algebra at a vertex of its quiver and show that its Coxeter polynomial is controlled in a uniform way by two polynomials attached to the poset that we call refined Coxeter polynomials. Several properties of these polynomials are discussed. Applications include new symmetry properties for Coxeter polynomials of ordinal sums of posets, constructions of new algebras of cyclotomic type and interlaced towers of algebras.


Quantitative homogenization theory for random suspensions in steady Stokes flow. This work develops a quantitative homogenization theory for random suspensions of rigid particles in a steady Stokes flow, and completes recent qualitative results. More precisely, we establish a large scale regularity theory for this Stokes problem, and we prove moment bounds for the associated correctors and optimal estimates on the homogenization error the latter further requires a quantitative ergodicity assumption on the random suspension. Compared to the corresponding quantitative homogenization theory for divergence form linear elliptic equations, substantial difficulties arise from the analysis of the fluid incompressibility and the particle rigidity constraints. Our analysis further applies to the problem of stiff inclusions in (compressible or incompressible) linear elasticity and in electrostatics it is also new in those cases, even in the periodic setting.


Model Learning with Personalized Interpretability Estimation (ML PIE). High stakes applications require AI generated models to be interpretable. Current algorithms for the synthesis of potentially interpretable models rely on objectives or regularization terms that represent interpretability only coarsely (e.g., model size) and are not designed for a specific user. Yet, interpretability is intrinsically subjective. In this paper, we propose an approach for the synthesis of models that are tailored to the user by enabling the user to steer the model synthesis process according to her or his preferences. We use a bi objective evolutionary algorithm to synthesize models with trade offs between accuracy and a user specific notion of interpretability. The latter is estimated by a neural network that is trained concurrently to the evolution using the feedback of the user, which is collected using uncertainty based active learning. To maximize usability, the user is only asked to tell, given two models at the time, which one is less complex. With experiments on two real world datasets involving 61 participants, we find that our approach is capable of learning estimations of interpretability that can be very different for different users. Moreover, the users tend to prefer models found using the proposed approach over models found using non personalized interpretability indices.


Simple phase noise measurement scheme for cavity stabilized laser systems. We describe a simple method for measuring the residual fast phase noise of a cavity stabilized laser using the cavity as a reference. The method is based on generating a beat note between the laser output and the strongly filtered light transmitted through the cavity. The beat note can be directly analyzed without requiring further calibration of system parameters. We apply the method to measure the residual phase noise of an external cavity diode laser (ECDL) locked to a reference cavity and compare the results with an analysis of the in loop error signal of the feedback system.


A generating tree with a single label for permutations avoiding the vincular pattern 1 32 4. In this paper we continue the study of permutations avoiding the vincular pattern 1 32 4 by constructing a generating tree with a single label for these permutations. This construction finally provides a clearer explanation of why a certain recursive formula found by Callan actually counts these permutations, insofar as this formula was originally obtained only as a consequence of a very intricated bijection with a certain class of ordered rooted trees. This responds to a theoretical issue already raised by Duchi, Guerrini and Rinaldi. As a byproduct, we also obtain an algorithm to generate all these permutations and we refine their enumeration according to a simple statistic, which is the number of right to left maxima to the right of 1.


On a structure preserving numerical method for fractional Fokker Planck equations. In this paper, we introduce and analyse numerical schemes for the homogeneous and the kinetic L 'evy Fokker Planck equation. The discretizations are designed to preserve the main features of the continuous model such as conservation of mass, heavy tailed equilibrium and (hypo)coercivity properties. We perform a thorough analysis of the numerical scheme and show exponential stability. Along the way, we introduce new tools of discrete functional analysis, such as discrete nonlocal Poincar 'e and interpolation inequalities adapted to fractional diffusion. Our theoretical findings are illustrated and complemented with numerical simulations.


Rayleigh quotients of the level set manifolds related to the nonlinear PDE. The main topic of this note is a discussion of applicability conditions of the Nehari manifold method depending on the value of parameters of equations. As the main tool, we apply the nonlinear generalized Rayleigh quotient method.


3D Point Cloud Registration with Multi Scale Architecture and Unsupervised Transfer Learning. We propose a method for generalizing deep learning for 3D point cloud registration on new, totally different datasets. It is based on two components, MS SVConv and UDGE. Using Multi Scale Sparse Voxel Convolution, MS SVConv is a fast deep neural network that outputs the descriptors from point clouds for 3D registration between two scenes. UDGE is an algorithm for transferring deep networks on unknown datasets in a unsupervised way. The interest of the proposed method appears while using the two components, MS SVConv and UDGE, together as a whole, which leads to state of the art results on real world registration datasets such as 3DMatch, ETH and TUM. The code is publicly available at https github.com humanpose1 MS SVConv .


Sphynx a parallel multi GPU graph partitioner for distributed memory systems. Graph partitioning has been an important tool to partition the work among several processors to minimize the communication cost and balance the workload. While accelerator based supercomputers are emerging to be the standard, the use of graph partitioning becomes even more important as applications are rapidly moving to these architectures. However, there is no distributed memory parallel, multi GPU graph partitioner available for applications. We developed a spectral graph partitioner, Sphynx, using the portable, accelerator friendly stack of the Trilinos framework. In Sphynx, we allow using different preconditioners and exploit their unique advantages. We use Sphynx to systematically evaluate the various algorithmic choices in spectral partitioning with a focus on the GPU performance. We perform those evaluations on two distinct classes of graphs regular (such as meshes, matrices from finite element methods) and irregular (such as social networks and web graphs), and show that different settings and preconditioners are needed for these graph classes. The experimental results on the Summit supercomputer show that Sphynx is the fastest alternative on irregular graphs in an application friendly setting and obtains a partitioning quality close to ParMETIS on regular graphs. When compared to nvGRAPH on a single GPU, Sphynx is faster and obtains better balance and better quality partitions. Sphynx provides a good and robust partitioning method across a wide range of graphs for applications looking for a GPU based partitioner.


IFoodCloud A Platform for Real time Sentiment Analysis of Public Opinion about Food Safety in China. The Internet contains a wealth of public opinion on food safety, including views on food adulteration, food borne diseases, agricultural pollution, irregular food distribution, and food production issues. In order to systematically collect and analyse public opinion on food safety, we developed IFoodCloud, a platform for the real time sentiment analysis of public opinion on food safety in China. It collects data from more than 3,100 public sources that can be used to explore public opinion trends, public sentiment, and regional attention differences of food safety incidents. At the same time, we constructed a sentiment classification model using multiple lexicon based and deep learning based algorithms integrated with IFoodCloud that provide an unprecedented rapid means of understanding the public sentiment toward specific food safety incidents. Our best model's F1 score achieved 0.9737. Further, three real world cases are presented to demonstrate the application and robustness. IFoodCloud could be considered a valuable tool for promote scientisation of food safety supervision and risk communication.


Robust Event Detection based on Spatio Temporal Latent Action Unit using Skeletal Information. This paper propose a novel dictionary learning approach to detect event action using skeletal information extracted from RGBD video. The event action is represented as several latent atoms and composed of latent spatial and temporal attributes. We perform the method at the example of fall event detection. The skeleton frames are clustered by an initial K means method. Each skeleton frame is assigned with a varying weight parameter and fed into our Gradual Online Dictionary Learning (GODL) algorithm. During the training process, outlier frames will be gradually filtered by reducing the weight that is inversely proportional to a cost. In order to strictly distinguish the event action from similar actions and robustly acquire its action unit, we build a latent unit temporal structure for each sub action. We evaluate the proposed method on parts of the NTURGB D dataset, which includes 209 fall videos, 405 ground lift videos, 420 sit down videos, and 280 videos of 46 otheractions. We present the experimental validation of the achieved accuracy, recall and precision. Our approach achieves the bestperformance on precision and accuracy of human fall event detection, compared with other existing dictionary learning methods. With increasing noise ratio, our method remains the highest accuracy and the lowest variance.


A boundary integral method for 3D nonuniform dielectric waveguide problems via the windowed Green function. This paper proposes an efficient boundary integral based "windowed Green function" methodology (WGF) for the numerical solution of three dimensional electromagnetic problems containing dielectric waveguides. The approach, which generalizes a two dimensional version of the method introduced recently, provides a highly effective solver for general electromagnetic problems containing waveguides. In particular, using an auxiliary integral representation, the proposed method is able to accurately model incident mode excitation. On the basis of a smooth window function, the integral operators along the infinite waveguide boundaries are smoothly truncated, resulting in errors that decay faster than any negative power of the window size.


On the rough solutions of 3D compressible Euler equations an alternative proof. The well posedness of Cauchy problem of 3D compressible Euler equations is studied. By using Smith Tataru's approach cite ST , we prove the local existence, uniqueness and stability of solutions for Cauchy problem of 3D compressible Euler equations, where the initial data of velocity, density, specific vorticity v, rho in H s, varpi in H s 0 (2 s 0 s) . It's an alternative and simplified proof of the result given by Q. Wang in cite WQEuler .


Bounded cohomology and homotopy colimits. We discuss an approach to the emph covering and emph vanishing theorems for the comparison map from bounded cohomology to singular cohomology, based on the observation that the comparison map is the coassembly map for bounded cohomology.


The Faber Krahn inequality for the Hermite operator with Robin boundary condition. In this paper we prove a Faber Krahn type inequality for the first eigenvalue of the Hermite operator with Robin boundary condition. We prove that the optimal set is an half space and we also address the equality case in such inequality.


A generalized Powers averaging property for commutative crossed products. We prove a generalized version of Powers' averaging property that characterizes simplicity of reduced crossed products C(X) rtimes lambda G , where G is a countable discrete group, and X is a compact Hausdorff space which G acts on minimally by homeomorphisms. As a consequence, we generalize results of Hartman and Kalantar on unique stationarity to the state space of C(X) rtimes lambda G and to Kawabe's generalized space of amenable subgroups operatorname Sub a(X,G) . This further lets us generalize a result of the first named author and Kalantar on simplicity of intermediate C algebras. We prove that if C(Y) subseteq C(X) is an inclusion of unital commutative G C algebras with X minimal and C(Y) rtimes lambda G simple, then any intermediate C algebra A satisfying C(Y) rtimes lambda G subseteq A subseteq C(X) rtimes lambda G is simple.


Minimal volume entropy and fiber growth. This article deals with topological assumptions under which the minimal volume entropy of a closed manifold M , and more generally of a finite simplicial complex X , vanishes or is positive. These topological conditions are expressed in terms of the growth of the fundamental group of the fibers of maps from a given finite simplicial complex X to lower dimensional simplicial complexes P . We also give examples of finite simplicial complexes with zero simplicial volume and arbitrarily large minimal volume entropy.


The KL Divergence between a Graph Model and its Fair I Projection as a Fairness Regularizer. Learning and reasoning over graphs is increasingly done by means of probabilistic models, e.g. exponential random graph models, graph embedding models, and graph neural networks. When graphs are modeling relations between people, however, they will inevitably reflect biases, prejudices, and other forms of inequity and inequality. An important challenge is thus to design accurate graph modeling approaches while guaranteeing fairness according to the specific notion of fairness that the problem requires. Yet, past work on the topic remains scarce, is limited to debiasing specific graph modeling methods, and often aims to ensure fairness in an indirect manner. We propose a generic approach applicable to most probabilistic graph modeling approaches. Specifically, we first define the class of fair graph models corresponding to a chosen set of fairness criteria. Given this, we propose a fairness regularizer defined as the KL divergence between the graph model and its I projection onto the set of fair models. We demonstrate that using this fairness regularizer in combination with existing graph modeling approaches efficiently trades off fairness with accuracy, whereas the state of the art models can only make this trade off for the fairness criterion that they were specifically designed for.


Color Variants Identification in Fashion e commerce via Contrastive Self Supervised Representation Learning. In this paper, we utilize deep visual Representation Learning to address an important problem in fashion e commerce color variants identification, i.e., identifying fashion products that match exactly in their design (or style), but only to differ in their color. At first we attempt to tackle the problem by obtaining manual annotations (depicting whether two products are color variants), and train a supervised triplet loss based neural network model to learn representations of fashion products. However, for large scale real world industrial datasets such as addressed in our paper, it is infeasible to obtain annotations for the entire dataset, while capturing all the difficult corner cases. Interestingly, we observed that color variants are essentially manifestations of color jitter based augmentations. Thus, we instead explore Self Supervised Learning (SSL) to solve this problem. We observed that existing state of the art SSL methods perform poor, for our problem. To address this, we propose a novel SSL based color variants model that simultaneously focuses on different parts of an apparel. Quantitative and qualitative evaluation shows that our method outperforms existing SSL methods, and at times, the supervised model.


WSSOD A New Pipeline for Weakly and Semi Supervised Object Detection. The performance of object detection, to a great extent, depends on the availability of large annotated datasets. To alleviate the annotation cost, the research community has explored a number of ways to exploit unlabeled or weakly labeled data. However, such efforts have met with limited success so far. In this work, we revisit the problem with a pragmatic standpoint, trying to explore a new balance between detection performance and annotation cost by jointly exploiting fully and weakly annotated data. Specifically, we propose a weakly and semi supervised object detection framework (WSSOD), which involves a two stage learning procedure. An agent detector is first trained on a joint dataset and then used to predict pseudo bounding boxes on weakly annotated images. The underlying assumptions in the current as well as common semi supervised pipelines are also carefully examined under a unified EM formulation. On top of this framework, weakly supervised loss (WSL), label attention and random pseudo label sampling (RPS) strategies are introduced to relax these assumptions, bringing additional improvement on the efficacy of the detection pipeline. The proposed framework demonstrates remarkable performance on PASCAL VOC and MSCOCO benchmark, achieving a high performance comparable to those obtained in fully supervised settings, with only one third of the annotations.


A Power and Area Efficient Lepton Hardware Encoder with Hash based Memory Optimization. Although it has been surpassed by many subsequent coding standards, JPEG occupies a large share of the storage load of the current data hosting service. To reduce the storage costs, DropBox proposed a lossless secondary compression algorithm, Lepton, to further improve the compression rate of JPEG images. However, the bloated probability models defined by Lepton severely restrict its throughput and energy efficiency. To solve this problem, we construct an efficient access probability based hash function for the probability models, and then propose a hardware friendly memory optimization method by combining the proposed hash function and the N way Set Associative unit. After that, we design a highly parameterized hardware structure for the probability models and finally implement a power and area efficient Lepton hardware encoder. To the best of our knowledge, this is the first hardware implementation of Lepton. The synthesis result shows that the proposed hardware structure reduces the total area of the probability models by 70.97 . Compared with DropBox's software solution, the throughput and the energy efficiency of the proposed Lepton hardware encoder are increased by 55.25 and 4899 times respectively. In terms of manufacturing cost, the proposed Lepton hardware encoder is also significantly lower than the general purpose CPU used by DropBox.


More is Less Inducing Sparsity via Overparameterization. In deep learning it is common to overparameterize neural networks, that is, to use more parameters than training samples. Quite surprisingly training the neural network via (stochastic) gradient descent leads to models that generalize very well, while classical statistics would suggest overfitting. In order to gain understanding of this implicit bias phenomenon we study the special case of sparse recovery (compressed sensing) which is of interest on its own. More precisely, in order to reconstruct a vector from underdetermined linear measurements, we introduce a corresponding overparameterized square loss functional, where the vector to be reconstructed is deeply factorized into several vectors. We show that, if there exists an exact solution, vanilla gradient flow for the overparameterized loss functional converges to a good approximation of the solution of minimal ell 1 norm. The latter is well known to promote sparse solutions. As a by product, our results significantly improve the sample complexity for compressed sensing via gradient flow descent on overparameterized models derived in previous works. The theory accurately predicts the recovery rate in numerical experiments. Our proof relies on a analyzing a certain Bregman divergence of the flow. This bypasses the obstacles caused by non convexity and should be of independent interest.


Linking the Dynamics of User Stance to the Structure of Online Discussions. This paper studies the dynamics of opinion formation and polarization in social media. We investigate whether users' stance concerning contentious subjects is influenced by the online discussions they are exposed to and interactions with users supporting different stances. We set up a series of predictive exercises based on machine learning models. Users are described using several posting activities features capturing their overall activity levels, posting success, the reactions their posts attract from users of different stances, and the types of discussions in which they engage. Given the user description at present, the purpose is to predict their stance in the future. Using a dataset of Brexit discussions on the Reddit platform, we show that the activity features regularly outperform the textual baseline, confirming the link between exposure to discussion and opinion. We find that the most informative features relate to the stance composition of the discussion in which users prefer to engage.


Multi Camera Placement via Z buffer Rendering for the Optimization of the Coverage and the Visual Hull. We can only allow human robot cooperation in a common work cell if the human integrity is guaranteed. A surveillance system with multiple cameras can detect collisions without contact to the human collaborator. A failure safe system needs to optimally cover the important areas of the robot work cell with safety overlap. We propose an efficient algorithm for optimally placing and orienting the cameras in a 3D CAD model of the work cell. In order to evaluate the quality of the camera constellation in each step, our method simulates the vision system using a z buffer rendering technique for image acquisition, a voxel space for the overlap and a refined visual hull method for a conservative human reconstruction. The simulation allows to evaluate the quality with respect to the distortion of images and advanced image analysis in the presence of static and dynamic visual obstacles such as tables, racks, walls, robots and people. Our method is ideally suited for maximizing the coverage of multiple cameras or minimizing an error made by the visual hull and can be extended to probabilistic space carving.


Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking. Multi person pose estimation and tracking serve as crucial steps for video understanding. Most state of the art approaches rely on first estimating poses in each frame and only then implementing data association and refinement. Despite the promising results achieved, such a strategy is inevitably prone to missed detections especially in heavily cluttered scenes, since this tracking by detection paradigm is, by nature, largely dependent on visual evidences that are absent in the case of occlusion. In this paper, we propose a novel online approach to learning the pose dynamics, which are independent of pose detections in current fame, and hence may serve as a robust estimation even in challenging scenarios including occlusion. Specifically, we derive this prediction of dynamics through a graph neural network (GNN) that explicitly accounts for both spatial temporal and visual information. It takes as input the historical pose tracklets and directly predicts the corresponding poses in the following frame for each tracklet. The predicted poses will then be aggregated with the detected poses, if any, at the same frame so as to produce the final pose, potentially recovering the occluded joints missed by the estimator. Experiments on PoseTrack 2017 and PoseTrack 2018 datasets demonstrate that the proposed method achieves results superior to the state of the art on both human pose estimation and tracking tasks.


Modeling Influencer Marketing Campaigns in Social Networks. Social media are extensively used in today's world, and facilitate quick and easy sharing of information, which makes them a good way to advertise products. Influencers of a social media network, owing to their massive popularity, provide a huge potential customer base. However, it is not straightforward to decide which influencers should be selected for an advertizing campaign that can generate high returns with low investment. In this work, we present an agent based model (ABM) that can simulate the dynamics of influencer advertizing campaigns in a variety of scenarios and can help to discover the best influencer marketing strategy. Our system is a probabilistic graph based model that provides the additional advantage to incorporate real world factors such as customers' interest in a product, customer behavior, the willingness to pay, a brand's investment cap, influencers' engagement with influence diffusion, and the nature of the product being advertized viz. luxury and non luxury. Using customer acquisition cost and conversion ratio as a unit economic, we evaluate the performance of different kinds of influencers under a variety of circumstances that are simulated by varying the nature of the product and the customers' interest. Our results exemplify the circumstance dependent nature of influencer marketing and provide insight into which kinds of influencers would be a better strategy under respective circumstances. For instance, we show that as the nature of the product varies from luxury to non luxury, the performance of celebrities declines whereas the performance of nano influencers improves. In terms of the customers' interest, we find that the performance of nano influencers declines with the decrease in customers' interest whereas the performance of celebrities improves.


Can Vision Transformers Learn without Natural Images?. Can we complete pre training of Vision Transformers (ViT) without natural images and human annotated labels? Although a pre trained ViT seems to heavily rely on a large scale dataset and human annotated labels, recent large scale datasets contain several problems in terms of privacy violations, inadequate fairness protection, and labor intensive annotation. In the present paper, we pre train ViT without any image collections and annotation labor. We experimentally verify that our proposed framework partially outperforms sophisticated Self Supervised Learning (SSL) methods like SimCLRv2 and MoCov2 without using any natural images in the pre training phase. Moreover, although the ViT pre trained without natural images produces some different visualizations from ImageNet pre trained ViT, it can interpret natural image datasets to a large extent. For example, the performance rates on the CIFAR 10 dataset are as follows our proposal 97.6 vs. SimCLRv2 97.4 vs. ImageNet 98.0.


Disease contagion models coupled to crowd motion and mesh free simulation. Modeling and simulation of disease spreading in pedestrian crowds has been recently become a topic of increasing relevance. In this paper, we consider the influence of the crowd motion in a complex dynamical environment on the course of infection of the pedestrians. To model the pedestrian dynamics we consider a kinetic equation for multi group pedestrian flow based on a social force model coupled with an Eikonal equation. This model is coupled with a non local SEIS contagion model for disease spread, where besides the description of local contacts also the influence of contact times has been modelled. Hydrodynamic approximations of the coupled system are derived. Finally, simulations of the hydrodynamic model are carried out using a mesh free particle method. Different numerical test cases are investigated including uni and bi directional flow in a passage with and without obstacles.


Bertinho Galician BERT Representations. This paper presents a monolingual BERT model for Galician. We follow the recent trend that shows that it is feasible to build robust monolingual BERT models even for relatively low resource languages, while performing better than the well known official multilingual BERT (mBERT). More particularly, we release two monolingual Galician BERT models, built using 6 and 12 transformer layers, respectively trained with limited resources ( 45 million tokens on a single GPU of 24GB). We then provide an exhaustive evaluation on a number of tasks such as POS tagging, dependency parsing and named entity recognition. For this purpose, all these tasks are cast in a pure sequence labeling setup in order to run BERT without the need to include any additional layers on top of it (we only use an output classification layer to map the contextualized representations into the predicted label). The experiments show that our models, especially the 12 layer one, outperform the results of mBERT in most tasks.


L p L q Boundedness of Spectral Multipliers of the Anharmonic Oscillator. In this note we study the L p L q boundedness of Fourier multipliers of anharmonic oscillators, and as a consequence also of spectral multipliers, for the range 1 p leq 2 leq q infty . The underlying Fourier analysis is associated with the eigenfunctions of an anharmonic oscillator in some family of differential operators having derivatives of any order. Our analysis relies on a version of the classical Paley type inequality, introduced by H "ormander, that we extend in our nonharmonic setting.


The Nirenberg problem on half spheres A bubbling off analysis. In this paper we perform a refined blow up analysis of finite energy approximated solutions to a Nirenberg type problem on half spheres. The later consists of prescribing, under minimal boundary conditions, the scalar curvature to be a given function. In particular we give a precise location of blow up points and blow up rates. Such an analysis shows that the blow up picture of the Nirenberg problem on half spheres is far more complicated that in the case of closed spheres. Indeed besides the combination of interior and boundary blow ups, there are non simple blow up points for subcritical solutions having zero or nonzero weak limit. The formation of such non simple blow ups is governed by a vortex problem, unveiling an unexpected connection with Euler equations in fluid dynamic and mean fields type equations in mathematical physics.


The Role of Nanotechnology to Combat Major Recent Worldwide Challenges. There are two major challenging problems facing humanity today which are the ongoing Coronavirus disease (COVID 19) pandemic started in late 2019 and the environmental crisis due to fossil fuels combustion causing over increase of greenhouse gases in the atmosphere. While the first problem seems to be a temporary remedy for the second one due to less travels by individuals, actual solution of both problems may require a comprehensive scientific, technological, and socioeconomic decisions. In this report we look at the role of nanotechnology and nano scale materials towards the solution of these two major challenges.


Enriched monoidal categories I centers. This work is the first one in a series, in which we develop a mathematical theory of enriched (braided) monoidal categories and their representations. In this work, we introduce the notion of the E 0 center ( E 1 center or E 2 center) of an enriched (monoidal or braided monoidal) category, and compute the centers explicitly when the enriched (braided monoidal or monoidal) categories are obtained from the canonical constructions. These centers have important applications in the mathematical theory of gapless boundaries of 2 1D topological orders and that of topological phase transitions in physics. They also play very important roles in the higher representation theory, which is the focus of the second work in the series.


Testing Surrogate Based Optimization with the Fortified Branin Hoo Extended to Four Dimensions. Some popular functions used to test global optimization algorithms have multiple local optima, all with the same value, making them all global optima. It is easy to make them more challenging by fortifying them via adding a localized bump at the location of one of the optima. In previous work the authors illustrated this for the Branin Hoo function and the popular differential evolution algorithm, showing that the fortified Branin Hoo required an order of magnitude more function evaluations. This paper examines the effect of fortifying the Branin Hoo function on surrogate based optimization, which usually proceeds by adaptive sampling. Two algorithms are considered. The EGO algorithm, which is based on a Gaussian process (GP) and an algorithm based on radial basis functions (RBF). EGO is found to be more frugal in terms of the number of required function evaluations required to identify the correct basin, but it is expensive to run on a desktop, limiting the number of times the runs could be repeated to establish sound statistics on the number of required function evaluations. The RBF algorithm was cheaper to run, providing more sound statistics on performance. A four dimensional version of the Branin Hoo function was introduced in order to assess the effect of dimensionality. It was found that the difference between the ordinary function and the fortified one was much more pronounced for the four dimensional function compared to the two dimensional one.


Bayesian Optimisation with Formal Guarantees. Application domains of Bayesian optimization include optimizing black box functions or very complex functions. The functions we are interested in describe complex real world systems applied in industrial settings. Even though they do have explicit representations, standard optimization techniques fail to provide validated solutions and correctness guarantees for them. In this paper we present a combination of Bayesian optimisation and SMT based constraint solving to achieve safe and stable solutions with optimality guarantees.


Improving the mass transfer rate and energy efficiency of solar still by enhancing the inner air circulation. Solar still is an eco friendly and convenient desalination system that can provide fresh water for remote areas and emergencies. The energy efficiency and productivity of conventional solar still are unsatisfying and need improvement, which requires a deep understanding of the heat and mass transfer process in solar still. In this work, the effect of the inner air circulation on the system's heat and mass transfer performance and energy efficiency are studied theoretically and experimentally. The theoretical results reveal that a weak acceleration of the air circulation inside the SS will significantly increase its performance, due to the improved mass transfer process. By enhancing the inner air circulation, the evaporation and condensation in the solar still can reach up to the limit, and the theoretical energy efficiency reaches up to 87 , 91.5 , and 94.5 , for the input power density at 300 W m2, 500 W m2, and 700 W m2, respectively. Besides, lower ambient temperature and higher ambient convective heat transfer coefficient will decrease the energy efficiency. Given the heat loss, the experimental energy efficiencies are only 3 to 6 lower than the theoretical results, which indicates that the great performance predicted by the theory can be realized in practical application. This work provides a new understanding and strategy for improving the performance of the solar still.


Exploiting Learned Policies in Focal Search. Recent machine learning approaches to deterministic search and domain independent planning employ policy learning to speed up search. Unfortunately, when attempting to solve a search problem by successively applying a policy, no guarantees can be given on solution quality. The problem of how to effectively use a learned policy within a bounded suboptimal search algorithm remains largely as an open question. In this paper, we propose various ways in which such policies can be integrated into Focal Search, assuming that the policy is a neural network classifier. Furthermore, we provide mathematical foundations for some of the resulting algorithms. To evaluate the resulting algorithms over a number of policies with varying accuracy, we use synthetic policies which can be generated for a target accuracy for problems where the search space can be held in memory. We evaluate our focal search variants over three benchmark domains using our synthetic approach, and on the 15 puzzle using a neural network learned using 1.5 million examples. We observe that Discrepancy Focal Search, which we show expands the node which maximizes an approximation of the probability that its corresponding path is a prefix of an optimal path, obtains, in general, the best results in terms of runtime and solution quality.


Quadratic and Cubic Regularisation Methods with Inexact function and Random Derivatives for Finite Sum Minimisation. This paper focuses on regularisation methods using models up to the third order to search for up to second order critical points of a finite sum minimisation problem. The variant presented belongs to the framework of 3 it employs random models with accuracy guaranteed with a sufficiently large prefixed probability and deterministic inexact function evaluations within a prescribed level of accuracy. Without assuming unbiased estimators, the expected number of iterations is mathcal O bigl( epsilon 1 2 bigr) or mathcal O bigl( epsilon 1 3 2 bigr) when searching for a first order critical point using a second or third order model, respectively, and of mathcal O bigl( max epsilon 1 3 2 , epsilon 2 3 bigr) when seeking for second order critical points with a third order model, in which epsilon j , j in 1,2 , is the j th order tolerance. These results match the worst case optimal complexity for the deterministic counterpart of the method. Preliminary numerical tests for first order optimality in the context of nonconvex binary classification in imaging, with and without Artifical Neural Networks (ANNs), are presented and discussed.


On multivariate randomized classification trees l 0 based sparsity, VC dimension and decomposition methods. Decision trees are widely used classification and regression models because of their interpretability and good accuracy. Classical methods such as CART are based on greedy approaches but a growing attention has recently been devoted to optimal decision trees. We investigate the nonlinear continuous optimization formulation proposed in Blanquero et al. (EJOR, vol. 284, 2020 COR, vol. 132, 2021) for (sparse) optimal randomized classification trees. Sparsity is important not only for feature selection but also to improve interpretability. We first consider alternative methods to sparsify such trees based on concave approximations of the l 0 norm". Promising results are obtained on 24 datasets in comparison with l 1 and l infty regularizations. Then, we derive bounds on the VC dimension of multivariate randomized classification trees. Finally, since training is computationally challenging for large datasets, we propose a general decomposition scheme and an efficient version of it. Experiments on larger datasets show that the proposed decomposition method is able to significantly reduce the training times without compromising the accuracy.


On the wave turbulence theory ergodicity for the elastic beam wave equation. Inspiring by a recent work 57 , we analyse a 3 wave kinetic equation, derived from the elastic beam wave equation on the lattice. The ergodicity condition states that two distinct wavevectors are supposed to be connected by a finite number of collisions. In this work, we prove that once the ergodicity condition is violated, the domain is broken into disconnected domains, called no collision and collisional invariant regions. If one starts with a general initial condition, whose energy is finite, then in the long time limit, the solutions of the 3 wave kinetic equation remain unchanged on the no collision region and relax to local equilibria on the disjoint collisional invariant regions. The equilibration temperature will differ from region to region. This behavior of 3 wave systems was first described by Spohn in 55 , without a detailed rigorous proof. Our proof follows Spohn's physically intuitive arguments.


Semantic OcTree Mapping and Shannon Mutual Information Computation for Robot Exploration. Autonomous robot operation in unstructured and unknown environments requires efficient techniques for mapping and exploration using streaming range and visual observations. Information based exploration techniques, such as Cauchy Schwarz quadratic mutual information (CSQMI) and fast Shannon mutual information (FSMI), have successfully achieved active binary occupancy mapping with range measurements. However, as we envision robots performing complex tasks specified with semantically meaningful objects, it is necessary to capture semantic categories in the measurements, map representation, and exploration objective. This work presents Semantic octree mapping and Shannon Mutual Information (SSMI) computation for robot exploration. We develop a Bayesian multi class mapping algorithm based on the OcTree data structure, where each voxel maintains a categorical distribution over object classes. Furthermore, we derive a closed form efficiently computable lower bound for the Shannon mutual information between the multi class OctoMap and a set of range category measurements using Run Length Encoding (RLE) of the sensor rays. The bound allows rapid evaluation of many potential robot trajectories for autonomous exploration and mapping. We compare our method against frontier based and FSMI exploration and apply it in a variety of simulated and real world experiments.


Bounds on set exit times of affine systems, using Linear Matrix Inequalities. Efficient computation of trajectories of switched affine systems becomes possible, if for any such hybrid system, we can manage to efficiently compute the sequence of switching times. Once the switching times have been computed, we can easily compute the trajectories between two successive switches as the solution of an affine ODE. Each switching time can be seen as a positive real root of an analytic function, thereby allowing for efficient computation by using root finding algorithms. These algorithms require a finite interval, within which to search for the switching time. In this paper, we study the problem of computing upper bounds on such switching times, and we restrict our attention to stable time invariant affine systems. We provide semi definite programming models to compute upper bounds on the time taken by the trajectories of an affine ODE to exit a set described as the intersection of a few generalized ellipsoids. Through numerical experiments, we show that the resulting bounds are tighter than bounds reported before, while requiring only a modest increase in computation time.


Piecewise orthogonal collocation for computing periodic solutions of renewal equations. We extend the use of piecewise orthogonal collocation to computing periodic solutions of renewal equations, which are particularly important in modeling population dynamics. We prove convergence through a rigorous error analysis. Finally, we show some numerical experiments confirming the theoretical results, and a couple of applications in view of bifurcation analysis.


Precompensation of 3D field distortions in remote focus two photon microscopy. Remote focusing is widely used in 3D two photon microscopy and 3D photostimulation because it enables fast axial scanning without moving the objective lens or specimen. However, due to the design constraints of microscope optics, remote focus units are often located in non telecentric positions in the optical path, leading to significant depth dependent 3D field distortions in the imaging volume. To address this limitation, we characterized 3D field distortions arising from non telecentric remote focusing and present a method for distortion precompensation. We demonstrate its applicability for a 3D two photon microscope that uses an acousto optic lens (AOL) for remote focusing and scanning. We show that the distortion precompensation method improves the pointing precision of the AOL microscope to 0.5 micrometer throughout the 400 x 400 x 400 micrometer imaging volume.


GNN RL Compression Topology Aware Network Pruning using Multi stage Graph Embedding and Reinforcement Learning. Model compression is an essential technique for deploying deep neural networks (DNNs) on power and memory constrained resources. However, existing model compression methods often rely on human expertise and focus on parameters' local importance, ignoring the rich topology information within DNNs. In this paper, we propose a novel multi stage graph embedding technique based on graph neural networks (GNNs) to identify the DNNs' topology and use reinforcement learning (RL) to find a suitable compression policy. We performed resource constrained (i.e., FLOPs) channel pruning and compared our approach with state of the art compression methods using over parameterized DNNs (e.g., ResNet and VGG 16) and mobile friendly DNNs (e.g., MobileNet and ShuffleNet). We evaluated our method on various models from typical to mobile friendly networks, such as ResNet family, VGG 16, MobileNet v1 v2, and ShuffleNet. The results demonstrate that our method can prune dense networks (e.g., VGG 16) by up to 80 of their original FLOPs. More importantly, our method outperformed state of the art methods and achieved a higher accuracy by up to 1.84 for ShuffleNet v1. Furthermore, following our approach, the pruned VGG 16 achieved a noticeable 1.38 times speed up and 141 MB GPU memory reduction.


Spanning trees in dense directed graphs. In 2001, Koml 'os, S 'ark "ozy and Szemer 'edi proved that, for each alpha 0 , there is some c 0 and n 0 such that, if n geq n 0 , then every n vertex graph with minimum degree at least (1 2 alpha)n contains a copy of every n vertex tree with maximum degree at most cn log n . We prove the corresponding result for directed graphs. That is, for each alpha 0 , there is some c 0 and n 0 such that, if n geq n 0 , then every n vertex directed graph with minimum semi degree at least (1 2 alpha)n contains a copy of every n vertex oriented tree whose underlying maximum degree is at most cn log n . As with Koml 'os, S 'ark "ozy and Szemer 'edi's theorem, this is tight up to the value of c . Our result improves a recent result of Mycroft and Naia, which requires the oriented trees to have underlying maximum degree at most Delta , for any constant Delta in mathbb N and sufficiently large n . In contrast to these results, our methods do not use Szemer 'edi's regularity lemma.